Bionic boot kernel oopses on Power

Bug #1775486 reported by Jeff Lane 
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
linux (Ubuntu)
In Progress
High
Unassigned
Bionic
In Progress
High
Unassigned

Bug Description

I'm trying to deploy Bionic to a Power S822LC (8335-GTB). The install fails because the boot kernel throws some oopses and reboots the server in an endless loop.

The system powers on. Petitboot loads and populates the boot options. The system PXE boots the ephemeral boot kernel and then OOPSes and reboots, starting the cycle over.

The following is the most I could get from a SOL session but it does show where the panics begin and the reboot happens at the end. The dump is from an attempt via MAAS to deploy Xenial with the 4.15 edge kernel. I also tried Bionic using the default kernel and got the same issue.

Next I tried Xenial with the 4.13 kernel (hwe-16.04) and that kernel successfully boots. So the issue seems localized to the 4.15 kernel.

[ 2.561982] vgaarb: loaded
[ 2.562036] usbcore: registered new interface driver usbfs
[ 2.562256] usbcore: registered new interface driver hub
[ 2.562652] usbcore: registered new device driver usb
[ 2.562834] pps_core: LinuxPPS API ver. 1 registered
[ 2.563307] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <email address hidden>
[ 2.589031] PTP clock support registered
[ 2.589996] EDAC MC: Ver: 3.0.0
[ 2.590513] NetLabel: Initializing
[ 2.590581] NetLabel: domain hash size = 128
[ 2.590613] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 2.591086] NetLabel: unlabeled traffic allowed by default
[ 2.592541] clocksource: Switched to clocksource timebase
[ 2.609779] VFS: Disk quotas dquot_6.6.0
[ 2.610031] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[ 2.613235] NET: Registered protocol family 2
[ 2.613651] TCP established hash table entries: 524288 (order: 6, 4194304 bytes)
[ 2.614772] TCP bind hash table entries: 65536 (order: 4, 1048576 bytes)
[ 2.619840] TCP: Hash tables configured (established 524288 bind 65536)
[ 2.620414] UDP hash table entries: 65536 (order: 5, 2097152 bytes)
[ 2.621044] UDP-Lite hash table entries: 65536 (order: 5, 2097152 bytes)
[ 2.622142] NET: Registered protocol family 1
[ 2.622284] pci 0009:00:00.0: enabling device (0101 -> 0103)
[ 2.622425] pci 0009:01:00.0: enabling device (0141 -> 0143)
[ 2.622915] pci 0009:02:01.0: enabling device (0141 -> 0143)
[ 2.623432] pci 0009:03:00.0: enabling device (0140 -> 0142)
[ 2.624048] Unpacking initramfs...
[ 3.541638] Freeing initrd memory: 53248K
[ 3.546247] Initialise system trusted keyrings
[ 3.546398] Key type blacklist registered
[ 3.546548] workingset: timestamp_bits=38 max_order=23 bucket_order=0
[ 3.548288] zbud: loaded
[ 3.551021] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 3.551827] fuse init (API version 7.26)
[ 3.554352] Key type asymmetric registered
[ 3.554487] Asymmetric key parser 'x509' registered
[ 3.554785] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[ 3.555088] io scheduler noop registered
[ 3.555115] io scheduler deadline registered
[ 3.555510] io scheduler cfq registered (default)
[ 3.557442] pci 0009:02:03.0: enabling device (0141 -> 0143)
[ 3.557634] pci 0009:05:00.0: enabling device (0141 -> 0143)
[ 3.557703] pci 0009:06:00.0: enabling device (0141 -> 0143)
[ 3.557753] Using unsupported 1024x768 vga at 3fe281010000, depth=32, pitch=4096
[ 3.691555] Console: switching to colour frame buffer device 128x48
[ 3.825001] fb0: Open Firmware frame buffer device on /pciex@3fffe40500000/pci@0/pci@0/pci@3/pci@0/vga@0
[ 3.825359] hvc0: raw protocol on /ibm,opal/consoles/serial@0 (boot console)
[ 3.825544] hvc0: No interrupts property, using OPAL event
[ 3.825856] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 3.828204] Linux agpgart interface v0.103
[ 3.838817] loop: module loaded
[ 3.839111] libphy: Fixed MDIO Bus: probed
[ 3.839213] tun: Universal TUN/TAP device driver, 1.6
[ 3.839350] PPP generic driver version 2.4.2
[ 3.839446] VFIO - User Level meta-driver version: 0.3
[ 3.839587] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 3.839728] ehci-pci: EHCI PCI platform driver
[ 3.839780] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 3.839825] ohci-pci: OHCI PCI platform driver
[ 3.839898] uhci_hcd: USB Universal Host Controller Interface driver
[ 3.840232] xhci_hcd 0009:03:00.0: xHCI Host Controller
[ 3.840298] xhci_hcd 0009:03:00.0: new USB bus registered, assigned bus number 1
[ 3.840580] xhci_hcd 0009:03:00.0: Using 64-bit DMA iommu bypass
[ 3.840830] xhci_hcd 0009:03:00.0: hcc params 0x0270f06d hci version 0x96 quirks 0x04000000
[ 3.841395] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 3.841516] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 3.841570] usb usb1: Product: xHCI Host Controller
[ 3.841746] usb usb1: Manufacturer: Linux 4.15.0-22-generic xhci-hcd
[ 3.841790] usb usb1: SerialNumber: 0009:03:00.0
[ 3.841963] hub 1-0:1.0: USB hub found
[ 3.842022] hub 1-0:1.0: 4 ports detected
[ 3.842183] xhci_hcd 0009:03:00.0: xHCI Host Controller
[ 3.842281] xhci_hcd 0009:03:00.0: new USB bus registered, assigned bus number 2
[ 3.842353] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[ 3.842606] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003
[ 3.842795] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 3.842849] usb usb2: Product: xHCI Host Controller
[ 3.843025] usb usb2: Manufacturer: Linux 4.15.0-22-generic xhci-hcd
[ 3.843071] usb usb2: SerialNumber: 0009:03:00.0
[ 3.843245] hub 2-0:1.0: USB hub found
[ 3.843282] hub 2-0:1.0: 4 ports detected
[ 3.843723] mousedev: PS/2 mouse device common for all mice
[ 3.846860] rtc-opal opal-rtc: rtc core: registered rtc-opal as rtc0
[ 3.846911] i2c /dev entries driver
[ 3.849478] device-mapper: uevent: version 1.0.3
[ 3.849725] device-mapper: ioctl: 4.37.0-ioctl (2017-09-20) initialised: <email address hidden>
[ 3.849790] powernv-cpufreq: cpufreq pstate min -59 nominal -35 max 0
[ 3.849834] powernv-cpufreq: Workload Optimized Frequency is enabled in the platform
[ 3.856079] ledtrig-cpu: registered to indicate activity on CPUs
[ 3.856943] NET: Registered protocol family 10
[ 3.857726] Bad kernel stack pointer 7fffc71fb4e0 at c00000000000b9ec
[ 3.857767] Oops: Bad kernel stack pointer, sig: 6 [#1]
[ 3.857795] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 3.857824] Modules linked in:
[ 3.857848] CPU: 72 PID: 1200 Comm: modprobe Not tainted 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 3.857896] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 3.857937] REGS: c00000003fc9fd40 TRAP: 0300 Not tainted (4.15.0-22-generic)
[ 3.857979] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 3.858024] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: -4611686018408968144
[ 3.858024] GPR00: 0000000000000000 00007fffc71fb4e0 0000000000000000 0000000000000000
[ 3.858024] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.858024] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.858024] GPR12: 0000744bac3b12e0 000000000002b200 0000000000000000 0000000000000000
[ 3.858024] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.858024] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.858024] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.858024] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.858394] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 3.858428] LR [0000000000000000] (null)
[ 3.858456] Call Trace:
[ 3.858471] Instruction dump:
[ 3.858493] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 3.858537] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 3.858581] ---[ end trace f861b3d694f4d169 ]---
[ 3.974021]
[ 3.974270] Bad kernel stack pointer 7fffd3f15040 at c00000000000b9ec
[ 3.974310] Oops: Bad kernel stack pointer, sig: 6 [#2]
[ 3.974338] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 3.974367] Modules linked in:
[ 3.974389] CPU: 21 PID: 1203 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 3.974443] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 3.974484] REGS: c00000003ff03d40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 3.974530] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 3.974574] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 2097152
[ 3.974574] GPR00: 0000000000000000 00007fffd3f15040 0000000000000000 0000000000000000
[ 3.974574] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.974574] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.974574] GPR12: 000076697db712e0 000000000002b200 0000000000000000 0000000000000000
[ 3.974574] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.974574] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.974574] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.974574] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 3.974944] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 3.974978] LR [0000000000000000] (null)
[ 3.975004] Call Trace:
[ 3.975018] Instruction dump:
[ 3.975043] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 3.975086] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 3.975130] ---[ end trace f861b3d694f4d16a ]---
[ 4.087381]
[ 4.087827] Bad kernel stack pointer 7fffe73c2160 at c00000000000b9ec
[ 4.087864] Oops: Bad kernel stack pointer, sig: 6 [#3]
[ 4.087892] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 4.087921] Modules linked in:
[ 4.087944] CPU: 1 PID: 1206 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 4.087991] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 4.088032] REGS: c00000003fff3d40 TRAP: 4100 Tainted: G D (4.15.0-22-generic)
[ 4.088078] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 4.088123] CFAR: c00000000000b934 SOFTE: 2
[ 4.088123] GPR00: 0000000000000000 00007fffe73c2160 0000000000000000 0000000000000000
[ 4.088123] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.088123] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.088123] GPR12: 0000740d1f1412e0 000000004002e700 0000000000000000 0000000000000000
[ 4.088123] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.088123] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.088123] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.088123] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.112912] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 4.122927] LR [0000000000000000] (null)
[ 4.122955] Call Trace:
[ 4.123482] Instruction dump:
[ 4.123503] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 4.130907] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 4.133852] ---[ end trace f861b3d694f4d16b ]---
[ 4.192416] usb 1-3: new high-speed USB device number 2 using xhci_hcd
[ 4.253422]
[ 4.253757] Bad kernel stack pointer 7fffd3a52440 at c00000000000b9ec
[ 4.253851] Oops: Bad kernel stack pointer, sig: 6 [#4]
[ 4.253881] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 4.253910] Modules linked in:
[ 4.253932] CPU: 10 PID: 1207 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 4.253986] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 4.254029] REGS: c00000003ff87d40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 4.254077] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 4.254121] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 1024
[ 4.254121] GPR00: 0000000000000000 00007fffd3a52440 0000000000000000 0000000000000000
[ 4.254121] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.254121] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.254121] GPR12: 0000789ed3dc12e0 000000000002b200 0000000000000000 0000000000000000
[ 4.254121] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.254121] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.254121] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.254121] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.254483] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 4.254517] LR [0000000000000000] (null)
[ 4.254544] Call Trace:
[ 4.254558] Instruction dump:
[ 4.254580] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 4.254623] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 4.254667] ---[ end trace f861b3d694f4d16c ]---
[ 4.365808]
[ 4.366058] Segment Routing with IPv6
[ 4.366104] NET: Registered protocol family 17
[ 4.366184] Key type dns_resolver registered
[ 4.366403] registered taskstats version 1
[ 4.366433] Loading compiled-in X.509 certificates
[ 4.366635] Bad kernel stack pointer 7fffef0c9190 at c00000000000b9ec
[ 4.366672] Oops: Bad kernel stack pointer, sig: 6 [#5]
[ 4.366699] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 4.366728] Modules linked in:
[ 4.366750] CPU: 2 PID: 1211 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 4.366797] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 4.366838] REGS: c00000003ffe7d40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 4.366885] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 4.366929] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 4
[ 4.366929] GPR00: 0000000000000000 00007fffef0c9190 0000000000000000 0000000000000000
[ 4.366929] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.366929] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.366929] GPR12: 0000716682a112e0 000000000002b200 0000000000000000 0000000000000000
[ 4.366929] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.366929] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.366929] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.366929] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.367295] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 4.367330] LR [0000000000000000] (null)
[ 4.367358] Call Trace:
[ 4.367372] Instruction dump:
[ 4.367393] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 4.367436] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 4.367481] ---[ end trace f861b3d694f4d16e ]---
[ 4.399575] usb 1-3: New USB device found, idVendor=046b, idProduct=ff01
[ 4.427423] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 4.482962] usb 1-3: Product: Virtual Hub
[ 4.483048] usb 1-3: Manufacturer: American Megatrends Inc.
[ 4.483078] usb 1-3: SerialNumber: serial
[ 4.485618]
[ 4.485818] Bad kernel stack pointer 7fffcbb0b2d0 at c00000000000b9ec
[ 4.485856] Oops: Bad kernel stack pointer, sig: 6 [#6]
[ 4.485884] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 4.485913] Modules linked in:
[ 4.485935] CPU: 73 PID: 1212 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 4.485991] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 4.486033] REGS: c00000003fc93d40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 4.486080] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 4.486127] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 512
[ 4.486127] GPR00: 0000000000000000 00007fffcbb0b2d0 0000000000000000 0000000000000000
[ 4.486127] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.486127] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.486127] GPR12: 0000766978a712e0 000000000002b200 0000000000000000 0000000000000000
[ 4.486127] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.486127] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.486127] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.486127] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.486642] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 4.486676] LR [0000000000000000] (null)
[ 4.486703] Call Trace:
[ 4.486718] Instruction dump:
[ 4.486872] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 4.487385] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 4.488377] ---[ end trace f861b3d694f4d16f ]---
[ 4.523412] hub 1-3:1.0: USB hub found
[ 4.544661] hub 1-3:1.0: 5 ports detected
[ 4.544722] usb 2-1: new SuperSpeed USB device number 2 using xhci_hcd
[ 4.601567] usb 2-1: New USB device found, idVendor=125f, idProduct=312b
[ 4.601604] usb 2-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 4.601645] usb 2-1: Product: ADATA USB Flash Drive
[ 4.601676] usb 2-1: Manufacturer: ADATA
[ 4.602040] usb 2-1: SerialNumber: 0000000000000454
[ 4.602909]
[ 4.603754] Loaded X.509 cert 'Build time autogenerated kernel key: 62d67402927c3c0c5eee5c14d259ff9a43d7ef2a'
[ 4.604091] zswap: loaded using pool lzo/zbud
[ 4.604322] Bad kernel stack pointer 7fffcc66a2e0 at c00000000000b9ec
[ 4.604358] Oops: Bad kernel stack pointer, sig: 6 [#7]
[ 4.604386] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 4.604416] Modules linked in:
[ 4.604439] CPU: 53 PID: 1215 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 4.604494] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 4.604536] REGS: c00000003fd83d40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 4.604583] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 4.604626] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 9007199254740992
[ 4.604626] GPR00: 0000000000000000 00007fffcc66a2e0 0000000000000000 0000000000000000
[ 4.604626] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.604626] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.604626] GPR12: 00007151b1a412e0 000000000002b200 0000000000000000 0000000000000000
[ 4.604626] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.604626] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.604626] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.604626] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.632134] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 4.639065] LR [0000000000000000] (null)
[ 4.642849] Call Trace:
[ 4.642863] Instruction dump:
[ 4.651567] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 4.669649] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 4.670664] ---[ end trace f861b3d694f4d170 ]---
[ 4.728469] usb 2-2: new SuperSpeed USB device number 3 using xhci_hcd
[ 4.785188]
[ 4.785431] Bad kernel stack pointer 7fffc1771c30 at c00000000000b9ec
[ 4.785471] Oops: Bad kernel stack pointer, sig: 6 [#8]
[ 4.785499] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 4.785528] Modules linked in:
[ 4.785550] CPU: 31 PID: 1216 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 4.785604] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 4.785645] REGS: c00000003fe8bd40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 4.785692] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 4.785735] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 2147483648
[ 4.785735] GPR00: 0000000000000000 00007fffc1771c30 0000000000000000 0000000000000000
[ 4.785735] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.785735] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.785735] GPR12: 00007bfeac6d12e0 000000000002b200 0000000000000000 0000000000000000
[ 4.785735] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.785735] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.785735] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.785735] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.804716] usb 2-2: New USB device found, idVendor=125f, idProduct=312b
[ 4.804717] usb 2-2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 4.804718] usb 2-2: Product: ADATA USB Flash Drive
[ 4.804719] usb 2-2: Manufacturer: ADATA
[ 4.804720] usb 2-2: SerialNumber: 15109234401100DF
[ 4.813342] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 4.813878] LR [0000000000000000] (null)
[ 4.818587] Call Trace:
[ 4.818601] Instruction dump:
[ 4.819077] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 4.819595] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 4.820591] ---[ end trace f861b3d694f4d171 ]---
[ 4.932493]
[ 4.932791] Bad kernel stack pointer 7fffcfe48e60 at c00000000000b9ec
[ 4.932931] Oops: Bad kernel stack pointer, sig: 6 [#9]
[ 4.932958] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 4.932987] Modules linked in:
[ 4.933035] CPU: 58 PID: 1219 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 4.933176] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 4.933217] REGS: c00000003fd47d40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 4.933386] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 4.933429] CFAR: c00000000000b934 DAR: 000000000001ff0c DSISR: 40000000 SOFTE: -4611686018408968144
[ 4.933429] GPR00: 0000000000000000 00007fffcfe48e60 0000000000000000 0000000000000000
[ 4.933429] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.933429] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.933429] GPR12: 00007cb0811812e0 000000000001ff0c 0000000000000000 0000000000000000
[ 4.933429] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.933429] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.933429] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.933429] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 4.934147] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 4.934181] LR [0000000000000000] (null)
[ 4.934209] Call Trace:
[ 4.934223] Instruction dump:
[ 4.934244] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 4.934287] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 4.935083] ---[ end trace f861b3d694f4d172 ]---
[ 4.964414] usb 1-3.1: new high-speed USB device number 3 using xhci_hcd
[ 5.049819]
[ 5.050057] Bad kernel stack pointer 7fffd5ffe980 at c00000000000b9ec
[ 5.050096] Oops: Bad kernel stack pointer, sig: 6 [#10]
[ 5.050124] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 5.050152] Modules linked in:
[ 5.050175] CPU: 76 PID: 1220 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 5.050232] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 5.064828] REGS: c00000003fc6fd40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 5.070192] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 5.072440] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 4096
[ 5.072440] GPR00: 0000000000000000 00007fffd5ffe980 0000000000000000 0000000000000000
[ 5.072440] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.072440] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.072440] GPR12: 0000739fdebf12e0 000000000002b200 0000000000000000 0000000000000000
[ 5.072440] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.072440] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.072440] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.072440] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.102554] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 5.108791] LR [0000000000000000] (null)
[ 5.109290] Call Trace:
[ 5.109305] Instruction dump:
[ 5.109808] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 5.110328] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 5.111382] ---[ end trace f861b3d694f4d173 ]---
[ 5.183960] usb 1-3.1: New USB device found, idVendor=046b, idProduct=ff20
[ 5.220698] usb 1-3.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 5.222258] usb 1-3.1: Product: Virtual Cdrom Device
[ 5.224861]
[ 5.224993] Key type big_key registered
[ 5.224995] Key type trusted registered
[ 5.225159] Bad kernel stack pointer 7fffe9531ae0 at c00000000000b9ec
[ 5.225160] Oops: Bad kernel stack pointer, sig: 6 [#11]
[ 5.225160] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 5.225162] Modules linked in:
[ 5.225164] CPU: 40 PID: 1224 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 5.225164] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 5.225165] REGS: c00000003fe1fd40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 5.225166] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 5.225168] CFAR: c00000000000b934 DAR: 000000000001ff0c DSISR: 40000000 SOFTE: -4611685743883389212
[ 5.225168] GPR00: 0000000000000000 00007fffe9531ae0 0000000000000000 0000000000000000
[ 5.225168] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.225168] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.225168] GPR12: 00007390790e12e0 000000000001ff0c 0000000000000000 0000000000000000
[ 5.225168] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.225168] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.225168] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.225168] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.225181] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 5.225181] LR [0000000000000000] (null)
[ 5.225182] Call Trace:
[ 5.225182] Instruction dump:
[ 5.225183] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 5.225185] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 5.225188] ---[ end trace f861b3d694f4d174 ]---
[ 5.341352]
[ 5.341548] Bad kernel stack pointer 7fffcd7c0650 at c00000000000b9ec
[ 5.341549] Oops: Bad kernel stack pointer, sig: 6 [#12]
[ 5.341549] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 5.341551] Modules linked in:
[ 5.341553] CPU: 59 PID: 1225 Comm: modprobe Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 5.341553] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 5.341554] REGS: c00000003fd3bd40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 5.341554] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 5.341557] CFAR: c00000000000b934 DAR: 000000000002b200 DSISR: 40000000 SOFTE: 576460752303423488
[ 5.341557] GPR00: 0000000000000000 00007fffcd7c0650 0000000000000000 0000000000000000
[ 5.341557] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.341557] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.341557] GPR12: 0000743d717612e0 000000000002b200 0000000000000000 0000000000000000
[ 5.341557] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.341557] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.341557] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.341557] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 5.341570] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 5.341570] LR [0000000000000000] (null)
[ 5.341570] Call Trace:
[ 5.341571] Instruction dump:
[ 5.341571] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 5.341574] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 5.341577] ---[ end trace f861b3d694f4d175 ]---
[ 5.455423]
[ 5.455537] Key type encrypted registered
[ 5.455540] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 5.455588] evm: HMAC attrs: 0x1
[ 5.458936] rtc-opal opal-rtc: setting system clock to 2018-06-07 00:51:01 UTC (1528332661)
[ 5.872807] usb 1-3.1: Manufacturer: American Megatrends Inc.
[ 5.872808] usb 1-3.1: SerialNumber: AAAABBBBCCCC1
[ 5.873558] integrity: Unable to open file: /etc/keys/x509_ima.der (-2)
[ 5.873561] integrity: Unable to open file: /etc/keys/x509_evm.der (-2)
[ 5.976415] usb 1-3.2: new high-speed USB device number 4 using xhci_hcd
[ 6.012386] Freeing unused kernel memory: 4864K
[ 6.013765] This architecture does not have kernel memory protection.
[ 6.019961] Bad kernel stack pointer 7fffcbaacb30 at c00000000000b9ec
[ 6.021947] Oops: Bad kernel stack pointer, sig: 6 [#13]
[ 6.024051] LE SMP NR_CPUS=2048 NUMA PowerNV
[ 6.067156] Modules linked in:
[ 6.067179] CPU: 77 PID: 1 Comm: init Tainted: G D 4.15.0-22-generic #24~16.04.1-Ubuntu
[ 6.072002] NIP: c00000000000b9ec LR: 0000000000000000 CTR: 0000000000000000
[ 6.078258] REGS: c00000003fc63d40 TRAP: 0300 Tainted: G D (4.15.0-22-generic)
[ 6.080432] MSR: 9000000000001031 <SF,HV,ME,IR,DR,LE> CR: 00000000 XER: 00000000
[ 6.088276] CFAR: c00000000000b934 DAR: 0000000000376000 DSISR: 40000000 SOFTE: 8192
[ 6.088276] GPR00: 0000000000000000 00007fffcbaacb30 0000000000000000 0000000000000000
[ 6.088276] GPR04: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 6.088276] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 6.088276] GPR12: 0000709fb5df12e0 0000000000376000 0000000000000000 0000000000000000
[ 6.088276] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 6.088276] GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 6.088276] GPR24: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 6.088276] GPR28: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 6.099950] usb 1-3.2: New USB device found, idVendor=046b, idProduct=ff40
[ 6.099951] usb 1-3.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 6.099952] usb 1-3.2: Product: Virtual Floppy Device
[ 6.099953] usb 1-3.2: Manufacturer: American Megatrends Inc.
[ 6.099954] usb 1-3.2: SerialNumber: AAAABBBBCCCC2
[ 6.157403] NIP [c00000000000b9ec] fast_exception_return+0x9c/0x184
[ 6.157902] LR [0000000000000000] (null)
[ 6.158416] Call Trace:
[ 6.158878] Instruction dump:
[ 6.158904] e84101a0 7c4ff120 e8410170 7c5a03a6 e8010070 e8410080 e8610088 e8810090
[ 6.159888] e8210078 7db243a6 7db142a6 7c0004ac <e9ad0000> 63ff0000 7db242a6 63ff0000
[ 6.160451] ---[ end trace f861b3d694f4d176 ]---
[ 6.200414] usb 1-3.3: new high-speed USB device number 5 using xhci_hcd
[ 6.275396]
[ 6.387947] usb 1-3.3: New USB device found, idVendor=046b, idProduct=ff31
[ 6.387986] usb 1-3.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 6.388031] usb 1-3.3: Product: Virtual HardDisk Device
[ 6.388061] usb 1-3.3: Manufacturer: American Megatrends Inc.
[ 6.388098] usb 1-3.3: SerialNumber: AAAABBBBCCCC3
[ 6.488415] usb 1-3.4: new low-speed USB device number 6 using xhci_hcd
[ 6.627445] usb 1-3.4: New USB device found, idVendor=046b, idProduct=ff10
[ 6.627565] usb 1-3.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 6.627676] usb 1-3.4: Product: Virtual Keyboard and Mouse
[ 6.627706] usb 1-3.4: Manufacturer: American Megatrends Inc.
[ 7.275494] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000006
[ 7.275494]
[ 7.400050] Rebooting in 10 seconds..
[ 110.077653487,5] OPAL: Reboot request...

Revision history for this message
Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote : Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1775486

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status: New → Incomplete
tags: added: bionic
Revision history for this message
Jeff Lane  (bladernr) wrote :

Unable to log collect as this happens in the ephemeral during boot and the system is not usable.

Changed in linux (Ubuntu):
status: Incomplete → Confirmed
Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v4.17 kernel[0].

If this bug is fixed in the mainline kernel, please add the following tag 'kernel-fixed-upstream'.

If the mainline kernel does not fix this bug, please add the tag: 'kernel-bug-exists-upstream'.

Once testing of the upstream kernel is complete, please mark this bug as "Confirmed".

Thanks in advance.

[0] http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.17

Changed in linux (Ubuntu):
importance: Undecided → High
Changed in linux (Ubuntu Bionic):
status: New → Confirmed
importance: Undecided → High
tags: added: kernel-da-key
tags: added: kernel-key
removed: kernel-da-key
Revision history for this message
Jeff Lane  (bladernr) wrote :

Hi Joseph,

I couldn't exactly reproduce this as it happens during deployment. BUT the closest I could get was deploying 16.04.4 (4.13) and then installing 4.17 once I was up and running. So I did that, and I am able to reboot the system into 4.17:

ubuntu@fesenkov:~$ uname -a
Linux fesenkov 4.17.0-041700-generic #201806041953 SMP Mon Jun 4 20:33:53 UTC 2018 ppc64le ppc64le ppc64le GNU/Linux
ubuntu@fesenkov:~$

Next I installed linux-image-generic from Cosmic which got me a combination of 16.04.4 with 4.15 (4.15.0-22) and that is not bootable due to the OOPses that lead me to this bug.

So this is the matrix of what's been tested:

16.04.4 - 4.13 - Success
16.04.4 - 4.15 - Fail
16.04.4 - 4.17 - Success

So 16.04.5 and 18.04(.1) are broken on this system.

tags: added: kernel-fixed-upstream
Revision history for this message
Joseph Salisbury (jsalisbury) wrote :

It looks like we should be able to perform a "Reverse" bisect to find the commit that fixes this in 4.17. We first need to identify the last bad kernel version and the first good one. Using your matrix in comment #4, can you test the following:

v4.16-rc1: http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.16-rc1/
v4.16 Final: http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.16/
v4.17-rc1: http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.17-rc1/

Thanks in advance!

Changed in linux (Ubuntu Bionic):
status: Confirmed → In Progress
Changed in linux (Ubuntu):
status: Confirmed → In Progress
Changed in linux (Ubuntu Bionic):
assignee: nobody → Joseph Salisbury (jsalisbury)
Changed in linux (Ubuntu):
assignee: nobody → Joseph Salisbury (jsalisbury)
tags: added: kernel-da-key
removed: kernel-key
Brad Figg (brad-figg)
tags: added: cscc
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.