KVM Instance booting from volume stacktraces

[Chris MacNaughton]

I've booted two instances from the same backing image (http://cloud-images.ubuntu.com/trusty/current/trusty-server-cloudimg-amd64-disk1.img), one using locally attached storage for the boot volume, one using a Cinder volume. The instance booted from cinder volume shows a cloud-init trace in the console log, while the local instance works correctly.

Instance booted from volume:

Cloud-init v. 0.7.5 running 'init' at Wed, 27 Jun 2018 09:43:10 +0000. Up 15.61 seconds.
ci-info: ++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++
ci-info: +--------+------+--------------+---------------+-------------------+
ci-info: | Device | Up | Address | Mask | Hw-Address |
ci-info: +--------+------+--------------+---------------+-------------------+
ci-info: | lo | True | 127.0.0.1 | 255.0.0.0 | . |
ci-info: | eth0 | True | 192.168.21.8 | 255.255.255.0 | fa:16:3e:aa:c3:54 |
ci-info: +--------+------+--------------+---------------+-------------------+
ci-info: +++++++++++++++++++++++++++++++++++Route info+++++++++++++++++++++++++++++++++++
ci-info: +-------+-----------------+--------------+-----------------+-----------+-------+
ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags |
ci-info: +-------+-----------------+--------------+-----------------+-----------+-------+
ci-info: | 0 | 0.0.0.0 | 192.168.21.1 | 0.0.0.0 | eth0 | UG |
ci-info: | 1 | 169.254.169.254 | 192.168.21.1 | 255.255.255.255 | eth0 | UGH |
ci-info: | 2 | 192.168.21.0 | 0.0.0.0 | 255.255.255.0 | eth0 | U |
ci-info: +-------+-----------------+--------------+-----------------+-----------+-------+
dmesg: write failed: Broken pipe
Generating public/private rsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_rsa_key.
Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.
The key fingerprint is:
c7:fb:76:96:ae:aa:6e:73:b1:28:ea:38:40:fa:34:75 root@20180627093956
The key's randomart image is:
+--[ RSA 2048]----+
| |
| |
| |
| . . E . |
|o . . S o |
|o o ... |
| + . ..o . |[ 36.260523] general protection fault: 0000 [#1] SMP
[ 36.260523] Modules linked in: dm_crypt kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel serio_raw aesni_intel aes_x86_64 glue_helper lrw gf128mul ablk_helper cryptd psmouse floppy
[ 36.260523] CPU: 0 PID: 1 Comm: init Not tainted 3.13.0-151-generic #201-Ubuntu
[ 36.260523] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.10.2-1ubuntu1~cloud0 04/01/2014
[ 36.260523] task: ffff88007c088000 ti: ffff88007c086000 task.ti: ffff88007c086000
[ 36.260523] RIP: 0010:[<ffffffff8106091b>] [<ffffffff8106091b>] switch_mm_irqs_off+0xbb/0x120
[ 36.260523] RSP: 0018:ffff88007c087ee0 EFLAGS: 00010046
[ 36.260523] RAX: 0000000000000001 RBX: ffff880037a54700 RCX: 0000000000000049
[ 36.260523] RDX: 0000000000000000 RSI: ffff880037a54700 RDI: ffff880037a54700
[ 36.260523] RBP: ffff88007c087f00 R08: 0000000000000000 R09: 0000000000000000
[ 36.260523] R10: 0000000000000001 R11: ffff88007b666780 R12: ffff8800378d6700
[ 36.260523] R13: 0000000000000000 R14: ffff880037653000 R15: ffff880037653000
[ 36.260523] FS: 00007f81d6e9a840(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000
[ 36.260523] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 36.260523] CR2: 00007ffcc8f0fec0 CR3: 0000000037924000 CR4: 0000000000360670
[ 36.260523] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 36.260523] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 36.260523] Stack:
[ 36.260523] ffff8800378d6700 ffff88007fc13b40 ffff880037a54700 0000000000000000
[ 36.260523] ffff88007c087f60 ffffffff8173c613 ffff88007c088000 0000000000013b40
[ 36.260523] ffff88007c087fd8 0000000000013b40 ffff88007c088000 00007ffcc8f10ae0
[ 36.260523] Call Trace:
[ 36.260523] [<ffffffff8173c613>] __schedule+0x2b3/0x750
[ 36.260523] [<ffffffff8173cf4e>] schedule_user+0x2e/0xa0
[ 36.260523] [<ffffffff817498dc>] sysret_careful+0x14/0x1a
[ 36.260523] Code: 24 e0 02 00 00 75 28 5b 41 5c 41 5d 41 5e 5d c3 48 8b 05 a5 58 cb 00 48 c1 e8 33 a8 01 74 d7 31 d2 b8 01 00 00 00 b9 49 00 00 00 <0f> 30 eb c7 48 89 df e8 57 09 6d 00 eb ce 65 c7 04 25 88 33 01
[ 36.260523] RIP [<ffffffff8106091b>] switch_mm_irqs_off+0xbb/0x120
[ 36.260523] RSP <ffff88007c087ee0>
[ 36.260523] ---[ end trace 122ffd09a2447ccd ]---

[Chris MacNaughton (chris.macnaughton)]

This is on an Openstack on top of Openstack, so we do have a nested KVM here as well

[Chris MacNaughton (chris.macnaughton)]

I've reproduced this without having a volume attached

[Ubuntu Kernel Bot (ubuntu-kernel-bot)]

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1778891

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

[Launchpad Janitor (janitor)]

[Expired for linux (Ubuntu) because there has been no activity for 60 days.]

[James Falcon (falcojr)]

Tracked in Github Issues as https://github.com/canonical/cloud-init/issues/3199