TestNetworkBasicOps.test_router_rescheduling failed with 'No IPv4 addresses found in: ...'

Bug #1622516 reported by Ihar Hrachyshka
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
neutron
Expired
High
Unassigned

Bug Description

http://logs.openstack.org/01/367501/1/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/3370b9c/console.html

2016-09-11 05:27:03.407325 | Captured traceback:
2016-09-11 05:27:03.407342 | ~~~~~~~~~~~~~~~~~~~
2016-09-11 05:27:03.407364 | Traceback (most recent call last):
2016-09-11 05:27:03.407389 | File "tempest/test.py", line 152, in wrapper
2016-09-11 05:27:03.407414 | return func(*func_args, **func_kwargs)
2016-09-11 05:27:03.407439 | File "tempest/test.py", line 107, in wrapper
2016-09-11 05:27:03.407464 | return f(self, *func_args, **func_kwargs)
2016-09-11 05:27:03.407500 | File "tempest/scenario/test_network_basic_ops.py", line 717, in test_router_rescheduling
2016-09-11 05:27:03.407524 | self._setup_network_and_servers()
2016-09-11 05:27:03.407561 | File "tempest/scenario/test_network_basic_ops.py", line 124, in _setup_network_and_servers
2016-09-11 05:27:03.407588 | floating_ip = self.create_floating_ip(server)
2016-09-11 05:27:03.407619 | File "tempest/scenario/manager.py", line 816, in create_floating_ip
2016-09-11 05:27:03.407648 | port_id, ip4 = self._get_server_port_id_and_ip4(thing)
2016-09-11 05:27:03.407681 | File "tempest/scenario/manager.py", line 795, in _get_server_port_id_and_ip4
2016-09-11 05:27:03.407707 | "No IPv4 addresses found in: %s" % ports)
2016-09-11 05:27:03.407753 | File "/opt/stack/new/tempest/.tox/tempest/local/lib/python2.7/site-packages/unittest2/case.py", line 845, in assertNotEqual
2016-09-11 05:27:03.407777 | raise self.failureException(msg)
2016-09-11 05:27:03.408051 | AssertionError: 0 == 0 : No IPv4 addresses found in: [{u'binding:host_id': u'ubuntu-xenial-rax-ord-4213156', u'id': u'ef74f0f4-aa7c-4fc7-ad90-e6aab9531309', u'allowed_address_pairs': [], u'status': u'BUILD', u'extra_dhcp_opts': [], u'name': u'', u'admin_state_up': True, u'tenant_id': u'05e1e2af7c5246b1ab35831d6ac59896', u'network_id': u'ebc57b5b-63cc-4ff9-86b1-f5bf13950908', u'description': u'', u'security_groups': [u'aa9f20fa-bdf7-4d4b-b072-55ade7d92776'], u'device_id': u'd08c8b65-ac5b-4d44-a954-41b3f8eb357f', u'created_at': u'2016-09-11T05:13:53', u'binding:vnic_type': u'normal', u'fixed_ips': [{u'ip_address': u'10.1.0.9', u'subnet_id': u'abbb64d7-a2e9-4ead-8b55-937e2415faff'}], u'device_owner': u'compute:None', u'binding:vif_type': u'bridge', u'updated_at': u'2016-09-11T05:14:00', u'port_security_enabled': True, u'binding:vif_details': {u'port_filter': True}, u'binding:profile': {}, u'revision_number': 9, u'mac_address': u'fa:16:3e:73:99:fe'}]

Revision history for this message
Ihar Hrachyshka (ihar-hrachyshka) wrote :
tags: added: gate-failure
Revision history for this message
Ihar Hrachyshka (ihar-hrachyshka) wrote :

In the log, it's seen that the agent updated the server with admin_state_up = True: http://logs.openstack.org/01/367501/1/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/3370b9c/logs/screen-q-agt.txt.gz?#_2016-09-11_05_13_57_924

There is an error in neutron-server log: http://logs.openstack.org/01/367501/1/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/3370b9c/logs/screen-q-svc.txt.gz?level=TRACE#_2016-09-11_05_14_04_833

"2016-09-11 05:14:04.833 15763 WARNING neutron.notifiers.nova [-] Nova event: {u'status': u'failed', u'tag': u'ef74f0f4-aa7c-4fc7-ad90-e6aab9531309', u'name': u'network-vif-plugged', u'server_uuid': u'd08c8b65-ac5b-4d44-a954-41b3f8eb357f', u'code': 404} returned with failed status"

Changed in neutron:
importance: Undecided → High
Revision history for this message
Hirofumi Ichihara (ichihara-hirofumi) wrote :

It still happens. I saw 4 hits in 24h.

Changed in neutron:
status: New → Confirmed
Revision history for this message
Claudiu Belu (cbelu) wrote :

I can also confirm this bug. I've seen it too many times in the Hyper-V CI as well. The issue is that the neutron port is not bound / still in BUILD state, and when an floating ip is created / attached, those ports are ignored. You can also see [1]. I've sent a fix for this: [2]

[1] https://bugs.launchpad.net/tempest/+bug/1631872
[2] https://review.openstack.org/#/c/383049/

tags: added: xenial
Revision history for this message
Jakub Libosvar (libosvar) wrote :

0 hits in the last 7 days using query from comment #1

Revision history for this message
Ihar Hrachyshka (ihar-hrachyshka) wrote :

0 hits in the last 7 days using query from comment #1

Changed in neutron:
status: Confirmed → Incomplete
Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for neutron because there has been no activity for 60 days.]

Changed in neutron:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.