[9.2] [SWARM] bdd_ha_one_controller_compact is failed from time to time

[Yury Tregubov]

The bdd_ha_one_controller_compact is failed from time to time on 9.2 MOS swarm runs due to failed OSTF:

======================================================================
FAIL: Deploy cluster with Cinder Block Device
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.test_bdd/fuelweb_test/helpers/decorators.py", line 120, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.test_bdd/fuelweb_test/tests/test_bdd.py", line 79, in bdd_ha_one_controller_compact
    self.fuel_web.run_ostf(cluster_id=cluster_id)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.test_bdd/core/helpers/log_helpers.py", line 215, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.test_bdd/fuelweb_test/models/fuel_web_client.py", line 1369, in run_ostf
    failed_test_name=failed_test_name, test_sets=test_sets)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.test_bdd/core/helpers/log_helpers.py", line 215, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.x.system_test.ubuntu.test_bdd/fuelweb_test/models/fuel_web_client.py", line 305, in assert_ostf_run
    indent=1)))
AssertionError: Failed 1 OSTF tests; should fail 0 tests. Names of failed tests:
  - Check network connectivity from instance via floating IP (failure) Instance is not reachable by IP. Please refer to OpenStack logs for more details.

The last fails were observed on snapshots:

#537 https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.test_bdd/79/
#526 https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.test_bdd/76
#510 https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.test_bdd/72/

Diagnostic snapshots are available in artifacts.

[Stanislaw Bogatkin (sbogatkin)]

Looks like an insufficient memory on nodes. It should not be reproducable today as we already have memory added. If it will be reproduced again then just reopen this bug. Marked as incomplete for now.

[Stanislaw Bogatkin (sbogatkin)]

*incomplete -> invalid

[Yury Tregubov (ytregubov)]

Is seen on MOS10 swarm runs: https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.test_bdd/72/testReport/(root)/bdd_ha_one_controller_compact/bdd_ha_one_controller_compact/