Upgrade authentication fails in OpenStack engine

Bug #1399144 reported by Evgeniy L
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
In Progress
High
Ihor Kalnytskyi

Bug Description

1. download tarball
2. start upgrade

Actual result:
It fails on OpenStack engine run, it fails after keystone was checked. After the error, keystone works fine, it means that keystone was not available for some period. Workaround is to run upgrade again.

2014-12-03 14:47:41 DEBUG 11548 (keystone_client) Cannot authenticate in keystone: HTTPConnectionPool(host='10.108.5.2', port=5000): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)
2014-12-03 14:47:41 ERROR 11548 (upgrade) OpenStackUpgrader: failed to upgrade: "401 Client Error: Unauthorized"
Traceback (most recent call last):
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/upgrade.py", line 51, in run
    upgrader.upgrade()
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/engines/openstack.py", line 61, in upgrade
    self.install_releases()
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/engines/openstack.py", line 144, in install_releases
    existing_releases = self.nailgun.get_releases()
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/fuel_upgrade/clients/nailgun_client.py", line 49, in get_releases
    r.ra1eb704034c31a7679c6cfbf13579219c7da75e4bise_for_status()
  File "/var/upgrade/.fuel-upgrade-venv/lib/python2.6/site-packages/requests/models.py", line 773, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
HTTPError: 401 Client Error: Unauthorized

Expected result:
Upgrade succeed

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.0"
  api: "1.0"
  build_number: "36"
  build_id: "2014-12-03_11-32-25"
  astute_sha: "16b252d93be6aaa73030b8100cf8c5ca6a970a91"
  fuellib_sha: "1eb704034c31a7679c6cfbf13579219c7da75e4b"
  ostf_sha: "7e79964ddb5092fc4568c6fb08a348bb326df2a8"
  nailgun_sha: "d2e732c5f54e35d0ed19f9a17489608dc1d11be8"
  fuelmain_sha: "7ab330b4958ab20955372e85de05e8732e8f6df2"

Tags: upgrade
Revision history for this message
Evgeniy L (rustyrobot) wrote :
description: updated
Revision history for this message
Evgeniy L (rustyrobot) wrote :

The priority should be raised if it is reproduced again.

Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :

Raise prio because it's reproducing on CI.

Changed in fuel:
importance: Medium → High
assignee: Fuel Python Team (fuel-python) → Igor Kalnitsky (ikalnitsky)
Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
Dmitry Pyzhov (dpyzhov) wrote :

Igor, how often does this issue appear? Can we postpone it to 6.1?

Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :

It's stably reproducible on CI, but I can't reproduce it on manual run.

Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-web (master)

Change abandoned by Igor Kalnitsky (<email address hidden>) on branch: master
Review: https://review.openstack.org/140016
Reason: This hack is no longer needed because the root cause was found - https://bugs.launchpad.net/fuel/+bug/1400701

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.