nova rebuild using openstack server rebuild is failing

[Manoj Moily]

During rebuild of a switched off instance using openstack server rebuild commnad is failing with below error,

START with options: [u'server', u'rebuild', u'--wait', u'--image', u'esis_cwg_ldap_rhel7u2_64_20SEP17', u'scspr0544339001', u'-v']
command: server rebuild -> openstackclient.compute.v2.server.RebuildServer
Using auth plugin: password
/usr/lib/python2.7/site-packages/novaclient/v2/images.py:106: DeprecationWarning: The novaclient.v2.images module is deprecated and will be removed after Nova 15.0.0 is released. Use on-openstacksdk instead.
  'or python-openstacksdk instead.', DeprecationWarning)
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. <class 'sqlalchemy.exc.OperationalError'> (HTTP 500) (Request-ID: req-33df9b70-3422-43c3-a6ef-56283344944e) END return value: 1

-------------------------
Version
-------
# cat /etc/nova/release
[Nova]
vendor = RDO
product = OpenStack Compute
package = 1.el7
---------------------------------------
b

[Matt Riedemann (mriedem)]

This doesn't seem to be a nova problem, but a problem with your database:

2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler [req-e8a61425-56dc-4dd7-bbca-05ae913f24c0 - - - - -] Failed to get metadata for instance id: b9f8fe03-a78b-43f3-bc1f-68ceaff3f978
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler Traceback (most recent call last):
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/api/metadata/handler.py", line 283, in _get_meta_by_instance_id
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler remote_address)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/api/metadata/handler.py", line 78, in get_metadata_by_instance_id
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler data = base.get_metadata_by_instance_id(instance_id, address)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/api/metadata/base.py", line 670, in get_metadata_by_instance_id
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler return InstanceMetadata(instance, address)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/api/metadata/base.py", line 138, in __init__
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler self.mappings = _format_instance_mapping(ctxt, instance)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/api/metadata/base.py", line 675, in _format_instance_mapping
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler ctxt, instance.uuid)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler result = fn(cls, context, *args, **kwargs)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/objects/block_device.py", line 357, in get_by_instance_uuid
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler context, instance_uuid, use_slave=use_slave)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 225, in wrapper
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler return f(*args, **kwargs)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/objects/block_device.py", line 352, in _db_block_device_mapping_get_all_by_instance
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler context, instance_uuid)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/db/api.py", line 1305, in block_device_mapping_get_all_by_instance
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler instance_uuid)
2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler File "/usr/lib/python2.7/site-packages/nova/db/sqlalchemy/api.py", line 169, ...