master node setup for 6.1 fuel-library tests fails with "list index out of range"

[Alexey Stupnikov]

Create environment and set up master node ... ERROR
Prepare master node ... SKIP: Failure in <function setup_master at 0x7f2197904410>
Bootstrap 5 slave nodes ... SKIP: Failure in <function setup_master at 0x7f2197904410>
Deploy cluster in HA mode with VLAN Manager ... SKIP: Failure in <function setup_master at 0x7f2197904410>

======================================================================
ERROR: Create environment and set up master node
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 333, in get_state
    self.instance = self.entry.home()
  File "/home/jenkins/workspace/fuel-main/env_centos-6_1/fuelweb_test/tests/base_test_case.py", line 33, in __init__
    self.env = EnvironmentModel()
  File "/home/jenkins/workspace/fuel-main/env_centos-6_1/fuelweb_test/models/environment.py", line 55, in __init__
    self.fuel_web = FuelWebClient(self.get_admin_node_ip(), self)
  File "/home/jenkins/workspace/fuel-main/env_centos-6_1/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/fuel-main/env_centos-6_1/fuelweb_test/models/environment.py", line 115, in get_admin_node_ip
    self.d_env.nodes(
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/models/environment.py", line 425, in nodes
    return Nodes(self)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/devops/models/environment.py", line 444, in __init__
    self.admin = self.admins[0]
IndexError: list index out of range

----------------------------------------------------------------------
Ran 4 tests in 0.016s

FAILED (SKIP=3, errors=1)
+ ec=1
+ [ != yes ]
+ [ no = yes ]
+ dos.py destroy env_centos-6_1
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
[description-setter] Description set: ERROR: Create environment and set up master node
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Email sending was cancelled by user script.
Finished: FAILURE

IMO self.admin[0] list should return something reasonable.

[Ivan (iremizov)]

This issue started failed job streak

[Matthew Mosesohn (raytrac3r)]

Fixed in https://review.fuel-infra.org/16339

[Alexey Stupnikov (astupnikov)]

Switched back to confirmed, since job is still failing with the same error: https://ci.fuel-infra.org/job/6.1.fuel-library.pkgs.centos.ha_nova_vlan/426/console

[Alexey Stupnikov (astupnikov)]

Matthew, could you please doublecheck your patch?

[Matthew Mosesohn (raytrac3r)]

Sorry, I wrote about the wrong bug. This issue is not related to verifying tasks.

[Matthew Mosesohn (raytrac3r)]

This is not a library, but but related to either CI env, fuel-devops, or fuel-qa. The deployment was successful, but there was a later error. This can't be a library bug, but instead should be investigated by Fuel CI team and Fuel QA.

[Alexey Stupnikov (astupnikov)]

Hi QA team, could you check this issue ASAP?

[Dennis Dmitriev (ddmitriev)]

Looks like there are used environments created with previous version of fuel-devops.

CI team, please remove all old environments to let these tests re-create them.

[Dmitry Kaigarodеsev (dkaiharodsev)]

will update from ci-team side:

- old venv's are deleted
- new one venv re-created

the job has been re-triggered:
https://ci.fuel-infra.org/job/6.1.fuel-library.pkgs.centos.ha_nova_vlan/428/console

[Alexey Stupnikov (astupnikov)]

Successfully passed CI test. Thanks everyone.