When I execute vm live-migrate ,the vm's state is always migrating, and live-migrate failed!

Bug #1886951 reported by zhangss
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
New
Undecided
Unassigned

Bug Description

When I execute vm live-migrate ,the vm's state is always migrating, and live-migrate failed!

[root@op-65 ~]# openstack server show 37e5c9a1-d576-44fa-98b7-1761e1ff92bd
+-------------------------------------+-------------------------------------------------------------+
| Field | Value |
+-------------------------------------+-------------------------------------------------------------+
| OS-DCF:diskConfig | AUTO |
| OS-EXT-AZ:availability_zone | nova |
| OS-EXT-SRV-ATTR:host | op-33 |
| OS-EXT-SRV-ATTR:hypervisor_hostname | op-33 |
| OS-EXT-SRV-ATTR:instance_name | instance-000000fb |
| OS-EXT-STS:power_state | Running |
| OS-EXT-STS:task_state | migrating |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2020-03-30T11:30:02.000000 |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | 内网32段=10.16.33.183 |
| config_drive | |
| created | 2019-10-23T03:26:38Z |
| flavor | ecs.g5.4xlarge (69411fe9-f2e4-456a-adcc-dc32c769f51f) |
| hostId | bd3c0cbac56d99e1abd34956b76002afe62391a9e04bfc536fba1297 |
| id | 37e5c9a1-d576-44fa-98b7-1761e1ff92bd |
| image | Centos 7.6(deepblue) (cdcea6c7-0c2e-4d96-ad32-c5234b72876a) |
| key_name | deepblue |
| name | 111222333 |
| progress | 99 |
| project_id | 2cc05e5768b4402887ce600c97a137fe |
| properties | |
| security_groups | name='default' |
| status | MIGRATING |
| updated | 2020-07-09T07:32:20Z |
| user_id | 658bd70ac42e4ad1ac04062fffe8da07 |
| volumes_attached | id='43a17b3a-e927-4df1-aaa1-64b8f1425b85' |
+-------------------------------------+-------------------------------------------------------------+

Revision history for this message
zhangss (intentc) wrote :
Download full text (38.7 KiB)

2020-07-09 15:32:07.017 31076 INFO nova.virt.libvirt.driver [-] [instance: 37e5c9a1-d576-44fa-98b7-1761e1ff92bd] Migration operation has completed
2020-07-09 15:32:07.017 31076 INFO nova.compute.manager [-] [instance: 37e5c9a1-d576-44fa-98b7-1761e1ff92bd] _post_live_migration() is started..
2020-07-09 15:32:07.040 31076 ERROR nova.volume.cinder [-] Delete attachment failed for attachment 1f8c00a7-d28b-46c5-b331-b56323557f04. Error: The request you have made requires authentication. (HTTP 401) Code: 401: Unauthorized: The request you have made requires authentication. (HTTP 401)
2020-07-09 15:32:07.040 31076 ERROR nova.compute.manager [-] [instance: 37e5c9a1-d576-44fa-98b7-1761e1ff92bd] Volume attachment 1f8c00a7-d28b-46c5-b331-b56323557f04 not deleted on source host op-33 during post_live_migration: The request you have made requires authentication. (HTTP 401): Unauthorized: The request you have made requires authentication. (HTTP 401)
2020-07-09 15:32:08.067 31076 INFO os_vif [-] Successfully unplugged vif VIFBridge(active=True,address=fa:16:3e:bd:15:13,bridge_name='brq8cc14819-f9',has_traffic_filtering=True,id=9e144127-5cad-4c48-8a91-1906c78c7334,network=Network(8cc14819-f923-4f11-97ed-65f721bbc39b),plugin='linux_bridge',port_profile=<?>,preserve_on_delete=False,vif_name='tap9e144127-5c')
2020-07-09 15:32:08.142 31076 ERROR nova.compute.manager [-] [instance: 37e5c9a1-d576-44fa-98b7-1761e1ff92bd] Post live migration at destination op-35 failed: NeutronAdminCredentialConfigurationInvalid_Remote: Networking client is experiencing an unauthorized exception.
Traceback (most recent call last):

  File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
    res = self.dispatcher.dispatch(message)

  File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
    result = func(ctxt, **new_args)

  File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 79, in wrapped
    function_name, call_dict, binary, tb)

  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
    self.force_reraise()

  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
    six.reraise(self.type_, self.value, self.tb)

  File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 69, in wrapped
    return f(self, context, *args, **kw)

  File "/usr/lib/python2.7/site-packages/nova/compute/utils.py", line 1323, in decorated_function
    return function(self, context, *args, **kwargs)

  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 215, in decorated_function
    kwargs['instance'], e, sys.exc_info())

  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
    self.force_reraise()

  File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
    six.reraise(self.type_, self.value, self.tb)

  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py"...

Revision history for this message
Artom Lifshitz (notartom) wrote :

This looks like very much a duplicate of 1879787, for which a fix is in progress.

That being said, in this case it looks like a misconfiguration, because Nova can access neither Cinder nor Neutron. Do you have a [neutron] and [cinder] section in your nova.conf, with valid auth information for each? For reference, here's what a [neutron] section for a devstack-deployed Nova looks like:

[neutron]
service_metadata_proxy = True
region_name = RegionOne
auth_strategy = keystone
project_domain_name = Default
project_name = service
user_domain_name = Default
password = secret
username = neutron
auth_url = http://192.168.200.10/identity
auth_type = password
default_floating_pool = public

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.