test_network_basic_ops smoke test failing

[Rabi Mishra]

tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops smoke test seems to be failing very often. This is blocking the heat gate as the grenade job is failing.

2016-05-04 04:45:16.740 | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops[compute,id-f323b3ba-82f8-4db7-8ea6-6a895869ec49,network,smoke]
2016-05-04 04:45:16.741 | -------------------------------------------------------------------------------------------------------------------------------------------------
2016-05-04 04:45:16.741 |
2016-05-04 04:45:16.741 | Captured traceback:
2016-05-04 04:45:16.741 | ~~~~~~~~~~~~~~~~~~~
2016-05-04 04:45:16.741 | Traceback (most recent call last):
2016-05-04 04:45:16.741 | File "tempest/test.py", line 113, in wrapper
2016-05-04 04:45:16.741 | return f(self, *func_args, **func_kwargs)
2016-05-04 04:45:16.742 | File "tempest/scenario/test_network_basic_ops.py", line 404, in test_network_basic_ops
2016-05-04 04:45:16.742 | msg="after disassociate "
2016-05-04 04:45:16.742 | File "tempest/scenario/test_network_basic_ops.py", line 208, in check_public_network_connectivity
2016-05-04 04:45:16.742 | self.check_floating_ip_status(floating_ip, floatingip_status)
2016-05-04 04:45:16.742 | File "tempest/scenario/manager.py", line 897, in check_floating_ip_status
2016-05-04 04:45:16.742 | st=status))
2016-05-04 04:45:16.742 | File "/opt/stack/new/tempest/.tox/smoke/local/lib/python2.7/site-packages/testtools/testcase.py", line 406, in assertEqual
2016-05-04 04:45:16.743 | self.assertThat(observed, matcher, message)
2016-05-04 04:45:16.743 | File "/opt/stack/new/tempest/.tox/smoke/local/lib/python2.7/site-packages/testtools/testcase.py", line 493, in assertThat
2016-05-04 04:45:16.743 | raise mismatch_error
2016-05-04 04:45:16.743 | testtools.matchers._impl.MismatchError: 'DOWN' != u'ACTIVE': FloatingIP: <"FloatingIP" addr="172.24.5.56" id="f5201e13-5952-4336-a076-2117aae7054d"> is at status: ACTIVE. failed to reach status: DOWN
2016-05-04 04:45:16.743 |
2016-05-04 04:45:16.743 |
2016-05-04 04:45:16.743 | Captured pythonlogging:

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/312432

[Matthew Treinish (treinish)]

This bug is just a stacktrace it doesn't have any real details on why or where things are failing. A link to log results would be a start.

[Tong Liu (liutong)]

From the log on the description, it seems like the floating IP failed to reach DOWN after disassociation.

[Rabi Mishra (rabi)]

I would argue that the stacktrace woul tell you where and how the test is failing.

Here are the failures: dozen in the last few days...

http://logs.openstack.org/54/305554/3/check/gate-grenade-dsvm-heat/60cb6ac/console.html#_2016-05-04_06_12_45_561

http://logs.openstack.org/39/311039/2/check/gate-grenade-dsvm-heat/75224d4/console.html#_2016-05-04_15_03_13_154

[OpenStack Infra (hudson-openstack)]

Change abandoned by Rabi Mishra (<email address hidden>) on branch: master
Review: https://review.openstack.org/312432