Node leaves in nailgun's database after restore master from backup non containing data about this node

[Egor Kotko]

{"build_id": "2014-07-28_10-30-48", "ostf_sha": "8c328521b1444f22c50463b9432193e20ed33813", "build_number": "367", "auth_required": true, "api": "1.0", "nailgun_sha": "83cc9ed44ebc8dd97248483b6d414ebbc4cff3c0", "production": "docker", "fuelmain_sha": "9adfbf5a52cedbdd16ec1a74f6c44c5b3419b87c", "astute_sha": "aa5aed61035a8dc4035ab1619a8bb540a7430a95", "feature_groups": ["mirantis"], "release": "5.1", "fuellib_sha": "d1c7f67b3cf51978d3178c8666ea398f2477dcb5"}

Steps to reproduce:

Execute:
sh "utils/jenkins/system_tests.sh" -t test -w $(pwd) -j "fuelweb_test" -i "$ISO_PATH" -V $(pwd)/venv/fuelweb_test -o --group=simple_backup_restore

https://review.openstack.org/#/c/104877/4

Expected result:
Cluster should be back to backup configuration:
1 Controller 1 Compute

Actual result:
Additional compute node stay in "Pending Addition" state. 1 Controller 1 Compute + 1 Compute node in Pending Addition state

FAIL: Backup/restore master node with cluster in simple mode
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ykotko/labs/GERRIT_BACKUP_AND_RESTORE/fuel-main/venv/fuelweb_test/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/ykotko/labs/GERRIT_BACKUP_AND_RESTORE/fuel-main/venv/fuelweb_test/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/ykotko/labs/GERRIT_BACKUP_AND_RESTORE/fuel-main/venv/fuelweb_test/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/ykotko/labs/GERRIT_BACKUP_AND_RESTORE/fuel-main/fuelweb_test/helpers/decorators.py", line 52, in wrapper
    return func(*args, **kwagrs)
  File "/home/ykotko/labs/GERRIT_BACKUP_AND_RESTORE/fuel-main/fuelweb_test/tests/test_simple.py", line 857, in simple_backup_restore
    2, len(self.fuel_web.client.list_cluster_nodes(cluster_id)))
AssertionError: 2 != 3

[Vladimir Kuklin (vkuklin)]

is it medium or high priority bug?

if it is medium - push it to 6.0

[Vladimir Sharshov (vsharshov)]

We have some strange behavior in case of pending nodes role for node which in bootstrap mode.

This node go to offline and after 3-5 minutes lose network connection and return back with normal stage after 10-15 minutes without external influence. At now moment no idea why and how it happened. Maybe helped restarting dhcp relay service in master node (speed up node availability but not immediately, maybe really not affected anything).

[Egor Kotko (ykotko)]

Fix the problem in the patch https://review.openstack.org/#/c/104877/