OSTF CLI reports error about KeyError: 'id'

[Bogdan Dobrelya]

Steps to reproduce:
1 Deploy neutron HA env 3 controllers, 3 computes.
2 Destroy any controller and wait for OSTF ha passed
3 Repeat step 2 several times

Expected: OSTF CLI ha healthcheck reports results
Actual: It may start to report error:
Traceback (most recent call last):
  File "/usr/bin/fuel", line 10, in <module>
    sys.exit(main())
  File "/usr/lib/python2.6/site-packages/fuelclient/cli/error.py", line 102, in wrapper
    return func(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/fuelclient/cli/parser.py", line 281, in main
    parser.parse()
  File "/usr/lib/python2.6/site-packages/fuelclient/cli/parser.py", line 155, in parse
    actions[parsed_params.action].action_func(parsed_params)
  File "/usr/lib/python2.6/site-packages/fuelclient/cli/actions/base.py", line 63, in action_func
    method(params)
  File "/usr/lib/python2.6/site-packages/fuelclient/cli/actions/health.py", line 71, in check
    env.run_test_sets(test_sets_to_check)
  File "/usr/lib/python2.6/site-packages/fuelclient/objects/environment.py", line 421, in run_test_sets
    self._testruns_ids = [tr['id'] for tr in testruns]
KeyError: 'id'

After restarting docker-ostf, the error may go away, and may not.

Build info:

      api: '1.0'
      astute_sha: ad6d59812b775bc12e7bd7aec8f81374595ffa63
      build_id: '270'
      build_number: '270'
      feature_groups:
      - mirantis
      fuel-agent_sha: 082a47bf014002e515001be05f99040437281a2d
      fuel-library_sha: f3780484874f5f4a1831714710ff552f33522915
      fuel-nailgun-agent_sha: d7027952870a35db8dc52f185bb1158cdd3d1ebd
      fuel-ostf_sha: 582a81ccaa1e439a3aec4b8b8f6994735de840f4
      fuelmain_sha: 9ab01caf960013dc882825dc9b0e11ccf0b81cb0
      nailgun_sha: 9a1207d02d943953e130a0a31b9f7aa855cd44db
      openstack_version: 2015.1.0-7.0
      production: docker
      python-fuelclient_sha: 9643fa07f1290071511066804f962f62fe27b512
      release: '7.0'

Note, I cannot make a logs snapshot due to the unauth error, including logs tarball instead.

[Ihor Kalnytskyi (ikalnytskyi)]

Bogdan, the snapshot is available under /var/www/nailgun/dump/. Please retrieve it and attach.

[Ihor Kalnytskyi (ikalnytskyi)]

Bogdan, I'm sorry, I can't reproduce this issue. Could you please bring more details or ping me once you face this issue again? From the provided traceback, it looks like that there were no "id" field in OSTF's response. I have no idea whether it's true or possible.

[Sergii Golovatiuk (sgolovatiuk)]

Lowering priority to medium as this bug doesn't meet 'High' criteria. It doesn't break a deployment, it doesn't break operation phase. It breaks OSTF tests only after some manual steps which barely used on production environments.

[Ihor Kalnytskyi (ikalnytskyi)]

Since it's not reproducable, rare case and Medium - move it to 7.0.

[Ihor Kalnytskyi (ikalnytskyi)]

Sorry, 8.0

[Alexander Kislitsky (akislitsky)]

No activity on bug in state 'Incomplete' since 09.09. Moving to 'Invalid'. If you will reproduce it, please reopen the bug.