Comment 3 for bug 1745149

This looks valid to me. During the boot process, it's failing to attach the volume because CONF.key_manager.fixed_key = None. We should handle that exception and roll back the volume status via Cinder calls as things are getting cleaned up.

2018-01-25 14:36:56.716 1 WARNING nova.volume.cinder [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] The support for the Cinder API v2 is deprecated, please upgrade to Cinder API v3.
2018-01-25 14:36:56.717 1 DEBUG cinderclient.v2.client [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] REQ: curl -g -i -X GET http://172.17.1.14:8776/v2/ef184f071981405d9071c7ca33a40303/volumes/58804519-e8fc-442b-ad7c-9066abf103d7/encryption -H "User-Agent: python-cinderclient" -H "X-OpenStack-Request-ID: req-9e16e37f-6bdb-445d-8024-1184a3dd7c45" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}671e4eff9977526aedde7b4cf4a18083a16178a5" _http_log_request /usr/lib/python2.7/site-packages/keystoneauth1/session.py:375
2018-01-25 14:36:57.506 1 DEBUG cinderclient.v2.client [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] RESP: [200] Date: Thu, 25 Jan 2018 14:36:56 GMT Server: Apache x-compute-request-id: req-d826157e-23b3-4d0b-947c-5688ebbdb4b4 x-openstack-request-id: req-d826157e-23b3-4d0b-947c-5688ebbdb4b4 Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 151 Content-Type: application/json
RESP BODY: {"cipher": "aes-xts-plain64", "encryption_key_id": "00000000-0000-0000-0000-000000000000", "provider": "nova.volume.encryptors.luks.LuksEncryptor", "key_size": 512, "control_location": "front-end"}
 _http_log_response /usr/lib/python2.7/site-packages/keystoneauth1/session.py:423
2018-01-25 14:36:57.507 1 DEBUG cinderclient.v2.client [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] GET call to cinderv2 for http://172.17.1.14:8776/v2/ef184f071981405d9071c7ca33a40303/volumes/58804519-e8fc-442b-ad7c-9066abf103d7/encryption used request id req-d826157e-23b3-4d0b-947c-5688ebbdb4b4 request /usr/lib/python2.7/site-packages/keystoneauth1/session.py:727
2018-01-25 14:36:57.508 1 DEBUG os_brick.encryptors [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] Using volume encryption metadata '{u'cipher': u'aes-xts-plain64', u'encryption_key_id': u'00000000-0000-0000-0000-000000000000', u'provider': u'nova.volume.encryptors.luks.LuksEncryptor', u'key_size': 512, u'control_location': u'front-end'}' for connection: {u'driver_volume_type': u'iscsi', 'connector': {'platform': 'x86_64', 'host': 'compute-0.localdomain', 'do_local_attach': False, 'ip': '172.17.1.13', 'os_type': 'linux2', 'multipath': False, 'initiator': u'iqn.1994-05.com.redhat:8f64791b5192'}, 'serial': u'58804519-e8fc-442b-ad7c-9066abf103d7', u'data': {u'access_mode': u'rw', u'target_discovered': False, u'encrypted': True, u'qos_specs': None, u'target_iqn': u'iqn.2010-10.org.openstack:volume-58804519-e8fc-442b-ad7c-9066abf103d7', u'target_portal': u'172.17.3.15:3260', u'volume_id': u'58804519-e8fc-442b-ad7c-9066abf103d7', u'target_lun': 0, 'device_path': '/dev/disk/by-id/scsi-3600140511f0e3859f374771a2aac5ca2', u'auth_password': u'***', u'auth_username': u'XuWZdZZqqRECPN3uD2J7', u'auth_method': u'CHAP'}} get_encryption_metadata /usr/lib/python2.7/site-packages/os_brick/encryptors/__init__.py:125
2018-01-25 14:36:57.508 1 WARNING nova.keymgr.conf_key_mgr [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] This key manager is insecure and is not recommended for production deployments
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] Instance failed to spawn: ValueError: keymgr.fixed_key not defined
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] Traceback (most recent call last):
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2192, in _build_resources
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] yield resources
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2007, in _build_and_run_instance
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] block_device_info=block_device_info)
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2814, in spawn
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] destroy_disks_on_failure=True)
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 5238, in _create_domain_and_network
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] encryption)
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1192, in _get_volume_encryptor
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] key_manager = keymgr.API(CONF)
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] File "/usr/lib/python2.7/site-packages/nova/keymgr/__init__.py", line 70, in API
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] return cls(conf)
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] File "/usr/lib/python2.7/site-packages/nova/keymgr/conf_key_mgr.py", line 67, in __init__
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] raise ValueError(_('keymgr.fixed_key not defined'))
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] ValueError: keymgr.fixed_key not defined
2018-01-25 14:36:57.509 1 ERROR nova.compute.manager [instance: 1065e02d-b199-4071-8a46-93c3f0f83702]
2018-01-25 14:36:57.510 1 INFO nova.compute.manager [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] Terminating instance
2018-01-25 14:36:57.513 1 DEBUG nova.notifications.objects.base [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] Defaulting the value of the field 'projects' to None in FlavorPayload due to 'Cannot call _load_projects on orphaned Flavor object' populate_schema /usr/lib/python2.7/site-packages/nova/notifications/objects/base.py:125
2018-01-25 14:36:57.526 1 DEBUG nova.compute.manager [req-9e16e37f-6bdb-445d-8024-1184a3dd7c45 db1a02ae2f5a4f4db07c1f62958ef9e7 ef184f071981405d9071c7ca33a40303 - default default] [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] Start destroying the instance on the hypervisor. _shutdown_instance /usr/lib/python2.7/site-packages/nova/compute/manager.py:2306
2018-01-25 14:36:57.529 1 DEBUG nova.virt.libvirt.driver [-] [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] During wait destroy, instance disappeared. _wait_for_destroy /usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:871
2018-01-25 14:36:57.529 1 INFO nova.virt.libvirt.driver [-] [instance: 1065e02d-b199-4071-8a46-93c3f0f83702] Instance destroyed successfully.