Deploy cluster with active-backup bonding and Neutron VLAN fails with timeout exceeded during network verification

Bug #1605704 reported by ElenaRossokhina
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
Medium
Fuel Sustaining
Mitaka
Invalid
Medium
Fuel Sustaining

Bug Description

Detailed bug description:
CI: https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.bonding_ha/3/console
Steps to reproduce:
Deploy cluster with active-backup bonding and Neutron VLAN
            1. Create cluster
            2. Add 3 nodes with controller role
            3. Add 1 node with compute role and 1 node with cinder role
            4. Setup bonding for all interfaces (including admin interface
               bonding)
            5. Run network verification
            6. Deploy the cluster
            7. Run network verification
            8. Run OSTF
            9. Save network configuration from slave nodes
            10. Reboot all environment nodes
            11. Verify that network configuration is the same after reboot
            12. Run network verification
            13. Run OSTF
Expected results:
All steps passed
Actual result:
Timeout error on step#12
Traceback (most recent call last):
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/helpers/decorators.py", line 120, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/tests/test_bonding.py", line 334, in deploy_bonding_neutron_vlan
    self.fuel_web.verify_network(cluster_id)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/helpers/decorators.py", line 360, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/__init__.py", line 59, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/models/fuel_web_client.py", line 1601, in verify_network
    self.assert_task_success(task, timeout, interval=10)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/__init__.py", line 59, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/models/fuel_web_client.py", line 323, in assert_task_success
    task = self.task_wait(task, timeout, interval)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/__init__.py", line 59, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.bonding_ha/fuelweb_test/models/fuel_web_client.py", line 1336, in task_wait
    "was exceeded: ".format(task=task["name"], timeout=timeout))
TimeoutError: Waiting task "verify_networks" timeout 300 sec was exceeded

Changed in fuel:
milestone: none → 9.1
Revision history for this message
ElenaRossokhina (esolomina) wrote :
Changed in fuel:
assignee: nobody → l23network (l23network)
Changed in fuel:
assignee: l23network (l23network) → Fuel Sustaining (fuel-sustaining-team)
importance: Undecided → High
status: New → Confirmed
Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Georgy Kibardin (gkibardin)
status: Confirmed → In Progress
Revision history for this message
Georgy Kibardin (gkibardin) wrote :

According to astute network verification has finally succeded, it just took longer than 5 mins for some reason.

Changed in fuel:
importance: High → Medium
assignee: Georgy Kibardin (gkibardin) → Fuel Sustaining (fuel-sustaining-team)
status: In Progress → Confirmed
Dmitry Pyzhov (dpyzhov)
Changed in fuel:
milestone: 9.1 → 10.0
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

Seemed to be infra issue - more than 100 tests are green since the report

Changed in fuel:
status: Confirmed → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.