Test nova vip failover failed with Timeout exeed on step waiting while ip recovers

[Tatyanka]

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  openstack_version: "2014.2-6.1"
  api: "1.0"
  build_number: "310"
  build_id: "2015-04-13_22-54-31"
  nailgun_sha: "d22c074dec091e5ddd8ea3003c37665058303cd5"
  python-fuelclient_sha: "9208ff4a08dcb674ce2df132399a5aa3ddfac21c"
  astute_sha: "d96a80b63198a578b2c159edbd76048819039eb0"
  fuellib_sha: "8b80657e9ceed8d59c2dff1c11e1481c7e69380e"
  ostf_sha: "c2a76a60ec4ebbd78e508216c2e12787bf25e423"
  fuelmain_sha: "335d3ed09ed79bd37e1f7a90442c4831c8845582"

Error Message

Waiting timed out

Stacktrace

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/6.1.system_test.centos.thread_5/fuelweb_test/helpers/decorators.py", line 66, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.system_test.centos.thread_5/fuelweb_test/tests/tests_strength/test_failover.py", line 286, in ha_nova_delete_vips
    super(self.__class__, self).ha_delete_vips()
  File "/home/jenkins/workspace/6.1.system_test.centos.thread_5/fuelweb_test/tests/tests_strength/test_failover_base.py", line 216, in ha_delete_vips
    wait(lambda: ip_assigned(slaves), timeout=30)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 98, in wait
    raise TimeoutError("Waiting timed out")
TimeoutError: Waiting timed out

Delete all management and public VIPs on all controller nodes. Centos with nova
Verify that they are restored.
Verify total amount of secondary IPs. Should be 2:
management and public

Scenario:
1. Delete all secondary VIP
2. Wait while it is being restored
3. Verify it is restored
4. Run OSTF

Actual result:
Timeout error was raised on step
 ip_assigned = lambda nodes: \
                    any([ip in self.fuel_web.ip_address_show(
                        n.name, 'haproxy', interface)
                        for n in nodes])
                logger.debug("Waiting while deleted ip restores ...")
                wait(lambda: ip_assigned(slaves), timeout=30)

[Tatyanka (tatyana-leontovich)]

http://jenkins-product.srt.mirantis.net:8080/job/6.1.system_test.centos.thread_5/92/testReport/%28root%29/ha_nova_delete_vips/ha_nova_delete_vips/?

[Dennis Dmitriev (ddmitriev)]

Moving to incomplete because the issue wasn't reproduced for a long time and there is lack of details for investigation, at least a diagnostic snapshot is necessary.

[Tatyanka (tatyana-leontovich)]

Issue comes from 6.1 and not reproduces now, so move to invalid