running os-refresh-config twice on conroler0 kills the node

Bug #1350477 reported by Nicholas Randon on 2014-07-30
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Critical
Unassigned

Bug Description

Running a debian derivative.

If os-refresh-config is run on a __working__ controller node (non ha) after o-r-c completes the now no longer works.

Note: o-r-c finished with no errors

The system then responds to any command as follows:
$ nova list
ERROR (ConnectionError): HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /v2.0/tokens (Caused by <class 'socket.error'>: [Errno 111] Connection refused)

in keystone log:
2014-07-30 17:37:40.441 11916 WARNING keystone.openstack.common.versionutils [-] Deprecated: keystone.token.backends.sql.Token is deprecated as of Juno in favor of keystone.token.persistence.backends.sql.Token and may be removed in K.
2014-07-30 17:37:40.471 11916 WARNING keystone.openstack.common.versionutils [-] Deprecated: keystone.middleware.core.XmlBodyMiddleware is deprecated as of Icehouse in favor of support for "application/json" only and may be removed in K.
/opt/stack/venvs/keystone/local/lib/python2.7/site-packages/sqlalchemy/sql/default_comparator.py:35: SAWarning: The IN-predicate on "assignment.actor_id" was invoked with an empty sequence. This results in a contradiction, which nonetheless can be expensive to evaluate. Consider alternative strategies for improved performance.
  return o[0](self, self.expr, op, *(other + o[1:]), **kwargs)

This is reproducible 100% of the time.

more info:
cat stackrc
export NOVA_VERSION=1.1
export OS_PASSWORD=cc338e2700bd740b9758f89d076e6b9d73823e87
export OS_AUTH_URL=http://localhost:5000/v2.0
export OS_USERNAME=admin
export OS_TENANT_NAME=admin
export COMPUTE_API_VERSION=1.1
export OS_NO_CACHE=True

after the o-r-c: export OS_AUTH_URL=http://localhost:5000/v2.0 stops working

if export OS_AUTH_URL=http://<cotroler IP>:5000/v2.0 is used all works again

so localhost seem to be unable to auth to keystone after the second o-r-c.

This has also be show to effect Ubuntu 14.0 devtest runs

Chris Jones (cmsj) on 2014-07-31
Changed in tripleo:
status: New → Confirmed
importance: Undecided → Critical
Chris Jones (cmsj) wrote :
Changed in tripleo:
status: Confirmed → Fix Released
status: Fix Released → Fix Committed
Jay Dobies (jdob) on 2014-08-01
Changed in tripleo:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers