Caught splitbrain, see debug log, count-0 at corosync_stability_check

Bug #1654265 reported by Alexandr Kostrikov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
New
High
Fuel Sustaining

Bug Description

During swarm[0] there were failure on scenario:
    Scenario:
        1. On the first controller kill corosync
        2. Verify for all controllers "pcs status nodes" reports
        3. Start corosync on the first controller
        4. Repeat steps 1-3 500 times

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.ha_neutron_destructive/fuelweb_test/helpers/decorators.py", line 120, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.ha_neutron_destructive/fuelweb_test/tests/tests_strength/test_failover.py", line 332, in ha_corosync_stability_check
    super(self.__class__, self).ha_corosync_stability_check()
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.ha_neutron_destructive/fuelweb_test/tests/tests_strength/test_failover_base.py", line 1186, in ha_corosync_stability_check
    'count-{0}'.format(count)), timeout=20)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 126, in wait_pass
    return raising_predicate()
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.ha_neutron_destructive/fuelweb_test/tests/tests_strength/test_failover_base.py", line 1186, in <lambda>
    'count-{0}'.format(count)), timeout=20)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/asserts.py", line 163, in assert_true
    raise ASSERTION_ERROR(message)
AssertionError: Caught splitbrain, see debug log, count-0

[0] https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.ha_neutron_destructive/167/testReport/(root)/ha_corosync_stability_check/ha_corosync_stability_check/

Additional information:
There were no available snapshot, need to wait for reproduce

Tags: area-library
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.