lbaasv2 tests fail with error

[Rabi Mishra]

Noticed at:

http://logs.openstack.org/52/511752/3/check/legacy-heat-dsvm-functional-convg-mysql-lbaasv2/dcd512d/job-output.txt.gz

lbaasv2 agent log:

http://logs.openstack.org/52/511752/3/check/legacy-heat-dsvm-functional-convg-mysql-lbaasv2/dcd512d/logs/screen-q-lbaasv2.txt.gz?#_Oct_16_02_26_51_171646

May be due to https://review.openstack.org/#/c/505701/

traceback:

2017-10-16 02:45:43.838922 | primary | 2017-10-16 02:45:43.838 | ==============================
2017-10-16 02:45:43.840365 | primary | 2017-10-16 02:45:43.840 | Failed 2 tests - output below:
2017-10-16 02:45:43.842320 | primary | 2017-10-16 02:45:43.841 | ==============================
2017-10-16 02:45:43.843926 | primary | 2017-10-16 02:45:43.843 |
2017-10-16 02:45:43.845738 | primary | 2017-10-16 02:45:43.845 | heat_integrationtests.functional.test_lbaasv2.LoadBalancerv2Test.test_create_update_loadbalancer
2017-10-16 02:45:43.847384 | primary | 2017-10-16 02:45:43.846 | ------------------------------------------------------------------------------------------------
2017-10-16 02:45:43.848836 | primary | 2017-10-16 02:45:43.848 |
2017-10-16 02:45:43.850193 | primary | 2017-10-16 02:45:43.849 | Captured traceback:
2017-10-16 02:45:43.851909 | primary | 2017-10-16 02:45:43.851 | ~~~~~~~~~~~~~~~~~~~
2017-10-16 02:45:43.853340 | primary | 2017-10-16 02:45:43.852 | Traceback (most recent call last):
2017-10-16 02:45:43.855053 | primary | 2017-10-16 02:45:43.854 | File "/opt/stack/new/heat/heat_integrationtests/functional/test_lbaasv2.py", line 109, in test_create_update_loadbalancer
2017-10-16 02:45:43.856727 | primary | 2017-10-16 02:45:43.856 | parameters=parameters)
2017-10-16 02:45:43.858396 | primary | 2017-10-16 02:45:43.857 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 437, in update_stack
2017-10-16 02:45:43.859969 | primary | 2017-10-16 02:45:43.859 | self._wait_for_stack_status(**kwargs)
2017-10-16 02:45:43.861455 | primary | 2017-10-16 02:45:43.861 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 368, in _wait_for_stack_status
2017-10-16 02:45:43.862957 | primary | 2017-10-16 02:45:43.862 | fail_regexp):
2017-10-16 02:45:43.864506 | primary | 2017-10-16 02:45:43.864 | File "/opt/stack/new/heat/heat_integrationtests/common/test.py", line 327, in _verify_status
2017-10-16 02:45:43.866142 | primary | 2017-10-16 02:45:43.865 | stack_status_reason=stack.stack_status_reason)
2017-10-16 02:45:43.867842 | primary | 2017-10-16 02:45:43.867 | heat_integrationtests.common.exceptions.StackBuildErrorException: Stack LoadBalancerv2Test-1022777367/f0a78a75-c1ed-4921-a7f7-c4028f3f60c3 is in UPDATE_FAILED status due to 'Resource UPDATE failed: ResourceInError: resources.loadbalancer: Went to status ERROR due to "Unknown"'
2017-10-16 02:45:43.869183 | primary | 2017-10-16 02:45:43.868 |
2017-10-16 02:45:43.870571 | primary | 2017-10-16 02:45:43.870 |
2017-10-16 02:45:43.872501 | primary | 2017-10-16 02:45:43.872 | heat_integrationtests.scenario.test_autoscaling_lbv2.AutoscalingLoadBalancerv2Test.test_autoscaling_loadbalancer_neutron
2017-10-16 02:45:43.874213 | primary | 2017-10-16 02:45:43.873 | ------------------------------------------------------------------------------------------------------------------------
2017-10-16 02:45:43.875784 | primary | 2017-10-16 02:45:43.875 |
2017-10-16 02:45:43.877352 | primary | 2017-10-16 02:45:43.876 | Captured traceback:
2017-10-16 02:45:43.878767 | primary | 2017-10-16 02:45:43.878 | ~~~~~~~~~~~~~~~~~~~
2017-10-16 02:45:43.880302 | primary | 2017-10-16 02:45:43.879 | Traceback (most recent call last):
2017-10-16 02:45:43.881941 | primary | 2017-10-16 02:45:43.881 | File "/opt/stack/new/heat/heat_integrationtests/scenario/test_autoscaling_lbv2.py", line 97, in test_autoscaling_loadbalancer_neutron
2017-10-16 02:45:43.883543 | primary | 2017-10-16 02:45:43.883 | self.check_num_responses(lb_url, 1)
2017-10-16 02:45:43.884968 | primary | 2017-10-16 02:45:43.884 | File "/opt/stack/new/heat/heat_integrationtests/scenario/test_autoscaling_lbv2.py", line 51, in check_num_responses
2017-10-16 02:45:43.886354 | primary | 2017-10-16 02:45:43.885 | self.assertEqual(expected_num, len(resp))
2017-10-16 02:45:43.887791 | primary | 2017-10-16 02:45:43.887 | File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 411, in assertEqual
2017-10-16 02:45:43.889172 | primary | 2017-10-16 02:45:43.888 | self.assertThat(observed, matcher, message)
2017-10-16 02:45:43.890601 | primary | 2017-10-16 02:45:43.890 | File "/usr/local/lib/python2.7/dist-packages/testtools/testcase.py", line 498, in assertThat
2017-10-16 02:45:43.892334 | primary | 2017-10-16 02:45:43.891 | raise mismatch_error
2017-10-16 02:45:43.895014 | primary | 2017-10-16 02:45:43.893 | testtools.matchers._impl.MismatchError: 1 != 0

[Rabi Mishra (rabi)]

Testing with the revert https://review.openstack.org/#/c/512177/.

[Rabi Mishra (rabi)]

So reverting 4f627b4e8dfe699944a196fe90e0642cced6278f fixes the lbaas issue and hence the heat gate.

[Slawek Kaplonski (slaweq)]

Proposed patch https://review.openstack.org/#/c/512199/
It was tested on https://review.openstack.org/#/c/512201/ and it looks that it fixes this issue so revert of 4f627b4e8dfe699944a196fe90e0642cced6278f is not necessary

[Boden R (boden)]

Base on comment #3, this appears to be something fix in neutron-lbaas, so perhaps the defect is best over there.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/neutron-lbaas 12.0.0.0b1 development milestone.

[Slawek Kaplonski (slaweq)]

It affected only neutron-lbaas and fix for it is already merged: https://review.openstack.org/#/c/512199/

[Akihiro Motoki (amotoki)]

neutron-lbaas bug is maintained in octavia launchpad.
Let's move the project and mark it as Fix Released.

[Viorel-Cosmin Miron (uhl-hosting)]

This is occuring in Train release.