Test upgrade_ha_one_controller_env failed with 500 Server Error: Internal Server Error

[Egor Kotko]

Test upgrade_ha_one_controller_env failed with 500 Server Error: Internal Server Error
Scenario:
            1. Revert snapshot with ha one controller ceph env
            2. Run upgrade on master
            3. Check that upgrade was successful
            4. Run network verification
            5. Run OSTF
            6. Add another compute node
            7. Re-deploy cluster
            8. Run OSTF

Test result:
http://jenkins-product.srt.mirantis.net:8080/view/7.0_swarm/job/7.0.system_test.ubuntu.upgrade_one_controller_classic/16/testReport/%28root%29/upgrade_ha_one_controller_env/upgrade_ha_one_controller_env/

/var/log/fuel_upgrade.log:
2015-07-27 13:54:44 ERROR 16062 (utils) HTTP request ends with 500 (attempt 1/3)
Traceback (most recent call last):
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/utils.py", line 848, in _wrapped
    return fn(*args, **kwargs)
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/clients/nailgun_client.py", line 51, in get_releases
    r.raise_for_status()
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/requests/models.py", line 773, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
HTTPError: 500 Server Error: Internal Server Error
2015-07-27 13:54:46 ERROR 16062 (utils) HTTP request ends with 500 (attempt 2/3)
Traceback (most recent call last):
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/utils.py", line 848, in _wrapped
    return fn(*args, **kwargs)
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/clients/nailgun_client.py", line 51, in get_releases
    r.raise_for_status()
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/requests/models.py", line 773, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
HTTPError: 500 Server Error: Internal Server Error
2015-07-27 13:54:48 ERROR 16062 (utils) HTTP request ends with 500 (attempt 3/3)
Traceback (most recent call last):
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/utils.py", line 848, in _wrapped
    return fn(*args, **kwargs)
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/clients/nailgun_client.py", line 51, in get_releases
    r.raise_for_status()
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/requests/models.py", line 773, in raise_for_status
    raise HTTPError(http_error_msg, response=self)

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "7.0"
  openstack_version: "2015.1.0-7.0"
  api: "1.0"
  build_number: "96"
  build_id: "2015-07-26_21-59-39"
  nailgun_sha: "d5c19f6afc66b5efe3c61ecb49025c1002ccbdc6"
  python-fuelclient_sha: "58c411d87a7eaf0fd6892eae2b5cb1eff4190c98"
  fuel-agent_sha: "2a65f11c10b0aeb5184247635a19740fc3edde21"
  astute_sha: "34e0493afa22999c4a07d3198ceb945116ab7932"
  fuel-library_sha: "84bacbae15136c0d0f23689e3c729f5dec6649a5"
  fuel-ostf_sha: "94a483c8aba639be3b96616c1396ef290dcc00cd"
  fuelmain_sha: "921918a3bd3d278431f35ad917989e46b0c24100"

[Dmitry Borodaenko (angdraug)]

Bug description is too generic, please update bug summary when root cause is found.

[Egor Kotko (ykotko)]

The test was passed successfully:
 http://jenkins-product.srt.mirantis.net:8080/view/7.0_swarm/job/7.0.system_test.ubuntu.upgrade_one_controller_classic/28/

[Alexander Ignatov (aignatov)]

@Egor, thank you for checking it once again!