Mirantis OpenStack

sometimes haproxy gets 504 when tries to reach keystone.

Bug #1425559 reported by Leontii Istomin
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Released
Critical
Alexander Makarov
Mirantis OpenStack 6.1
6.0.x
Fix Released
High
Alexander Nevenchannyy
Mirantis OpenStack 6.0-mu-4

Bug Description

[root@fuel ~]# fuel --fuel-version
api: '1.0'
astute_sha: f7cda2171b0b677dfaeb59693d980a2d3ee4c3e0
auth_required: true
build_id: 2015-02-23_20-49-44
build_number: '103'
feature_groups:
- mirantis
fuellib_sha: 3a441bce1b525fe03ace45adfdda495cb64869d2
fuelmain_sha: a715aba8caf200390498a6bd29e6bffd9783f242
nailgun_sha: adbc77b3435d1484e39a46075bd5d558d7ec68b7
ostf_sha: 3b57985d4d2155510894a1f6d03b478b201f7780
production: docker
release: 6.0.1
release_versions:
  2014.2-6.0.1:
    VERSION:
      api: '1.0'
      astute_sha: f7cda2171b0b677dfaeb59693d980a2d3ee4c3e0
      build_id: 2015-02-23_20-49-44
      build_number: '103'
      feature_groups:
      - mirantis
      fuellib_sha: 3a441bce1b525fe03ace45adfdda495cb64869d2
      fuelmain_sha: a715aba8caf200390498a6bd29e6bffd9783f242
      nailgun_sha: adbc77b3435d1484e39a46075bd5d558d7ec68b7
      ostf_sha: 3b57985d4d2155510894a1f6d03b478b201f7780
      production: docker
      release: 6.0.1

Baremetal,Ubuntu, HA, Neutron-vlan,Ceilometer,Сeph-all, Debug, nova-quotas,6.0.1_103
Controllers:3 Computes:22

Deployment was successful, but durin rally tests I have found that keystone client (of rally) can't connect to server with 504 ERROR:

2015-02-25 07:36:49.925 19840 WARNING rally.common.broker [-] Failed to consume a task from the queue: Authorization Failed: Gateway Timeout (HTTP 504)
2015-02-25 07:36:49.928 19840 ERROR rally.common.broker [-] Gateway Timeout (HTTP 504)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker Traceback (most recent call last):
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/rally/common/broker.py", line 41, in _consumer
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker consume(cache, queue.popleft())
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/rally/benchmark/context/users.py", line 184, in consume
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker tenant_id, user_dom)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/rally/benchmark/wrappers/keystone.py", line 129, in create_user
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker user = self.client.users.create(username, password, email, project_id)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/v2_0/users.py", line 102, in create
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker return self._create('/users', params, "user", log=not bool(password))
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/base.py", line 151, in _create
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker return self._post(url, body, response_key, return_raw, **kwargs)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/base.py", line 165, in _post
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker resp, body = self.client.post(url, body=body, **kwargs)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/adapter.py", line 170, in post
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker return self.request(url, 'POST', **kwargs)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/adapter.py", line 200, in request
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/adapter.py", line 89, in request
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker return self.session.request(url, method, **kwargs)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/utils.py", line 318, in inner
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker return func(*args, **kwargs)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker File "/opt/stack/.venv/lib/python2.7/site-packages/keystoneclient/session.py", line 384, in request
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker raise exceptions.from_response(resp, method, url)
2015-02-25 07:36:49.928 19840 TRACE rally.common.broker GatewayTimeout: Gateway Timeout (HTTP 504)

 vip__public (ocf::mirantis:ns_IPaddr2): Started node-7
 vip__management (ocf::mirantis:ns_IPaddr2): Started node-7

At the same time I can see in haproxy log I can see 504 response from keystone-server on primary controller:
<134>Feb 25 07:36:48 node-7 haproxy[14779]: 172.16.46.58:54712 [25/Feb/2015:07:35:48.294] keystone-2 keystone-2/node-7 0/0/0/-1/60002 504 194 - - sH-- 798/2/2/2/0 0/0 "GET /v2.0/tenants HTTP/1.1"

keystone and haproxy logs from node-7 (primary controller) are attached
DG will be asap

Revision history for this message
Leontii Istomin (listomin) wrote :
Leontii Istomin (listomin)
Changed in mos:
assignee: nobody → MOS Keystone (mos-keystone)
Revision history for this message
Leontii Istomin (listomin) wrote :

DG: https://drive.google.com/a/mirantis.com/file/d/0Bx4ptZV1Jt7hS2czNGxqMHdlT1k/view?usp=sharing

Dmitry Mescheryakov (dmitrymex)
Changed in mos:
status: New → Confirmed
importance: Undecided → High
milestone: none → 6.1
Revision history for this message
Alexander Nevenchannyy (anevenchannyy) wrote :

HaProxy return 504 when the response timeout strikes before the server responds.
See: http://cbonte.github.io/haproxy-dconv/configuration-1.5.html

Current default settings in haproxy.cfg of timeout server/client are 1 minute.

IMHO, this is keystone problem...

Revision history for this message
Boris Pavlovic (boris-42) wrote :

+1 Keystone just died.

Revision history for this message
Dina Belova (dbelova) wrote :

Critical for 6.1 200 nodes certification

Changed in mos:
importance: High → Critical
Revision history for this message
Boris Bobrov (bbobrov) wrote :

 - this is definetely not the problem with logs we had
 - now only keystone on node-201 is affected
 - now only keystone:5000 is affected

strace is not informative to me. Neither are memcache stats.

Now I need a proper Python on the nodes, because current doesn't let me use gdb.

Revision history for this message
Alexander Makarov (amakarov) wrote :

As an option we can try SQL backend for revocations.
Add the following to [revoke] section of keystone config:
driver=keystone.contrib.revoke.backends.sql.Revoke

Alexander Makarov (amakarov)
Changed in mos:
assignee: MOS Keystone (mos-keystone) → Alexander Makarov (amakarov)
status: Confirmed → In Progress
Revision history for this message
Alexander Makarov (amakarov) wrote :
Download full text (5.9 KiB)

TL;DR: Database seems to be the bottleneck.

Placing a timeout in keystone-all has given a traceback:

2015-03-19 07:07:57.741 21373 ERROR keystone.common.wsgi [-] An unexpected error prevented the server from fulfilling your request: (Disable debug mode to suppress these details.)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi Traceback (most recent call last):
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/keystone/common/wsgi.py", line 223, in __call__
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi result = method(context, **params)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/keystone/token/controllers.py", line 100, in authenticate
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi context, auth)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/keystone/token/controllers.py", line 303, in _authenticate_local
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi user_id, tenant_id)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/keystone/token/controllers.py", line 386, in _get_project_roles_and_ref
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi user_id, tenant_id)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/keystone/assignment/core.py", line 201, in get_roles_for_user_and_project
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi user_role_list = _get_user_project_roles(user_id, project_ref)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/keystone/assignment/core.py", line 182, in _get_user_project_roles
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi tenant_id=project_ref['id'])
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/keystone/assignment/backends/sql.py", line 99, in _get_metadata
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi refs = q.all()
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2300, in all
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi return list(self)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 66, in instances
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi fetch = cursor.fetchall()
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/result.py", line 787, in fetchall
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi self.cursor, self.context)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1156, in _handle_dbapi_exception
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi util.raise_from_cause(newraise, exc_info)
2015-03-19 07:07:57.741 21373 TRACE keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalch...

Read more...

Revision history for this message
Alexander Makarov (amakarov) wrote :

I suspect the same problem as with logging system: sqlalchemy uses locks AND initialized before eventlet monkeypatching.

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote :

Alex,

So want to try this other patch or a variant again?
https://review.openstack.org/#/c/154630/4/bin/keystone-all,cm

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1.mira4.git.1255f32.76fd475

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkeypatching
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-5061/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1~mira3+git.1255f32.76fd475

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkeypatching
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /trusty-fuel-6.1-stable-5061/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1.mira4.git.d1b6d6e.76fd475

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-5061/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1~mira3+git.d1b6d6e.76fd475

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /trusty-fuel-6.1-stable-5061/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1.mira5.git.30e9eca.76fd475

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-5061/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1~mira4+git.30e9eca.76fd475

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /trusty-fuel-6.1-stable-5061/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1.mira5

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /centos-fuel-6.1-stable/

Revision history for this message
OSCI Robot (oscirobot) wrote :

package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.1~mira4

Changeset: https://review.fuel-infra.org/5061
project: openstack/keystone
branch: openstack-ci/fuel-6.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /trusty-fuel-6.1-stable/

Alexander Makarov (amakarov)
Changed in mos:
status: In Progress → Fix Committed
Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.1.mira6.git.2958d54.823fcc4

Changeset: https://review.fuel-infra.org/5179
project: openstack/keystone
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
openstack-keystone-2014.1.3-fuel5.1.1.mira6.git.2958d54.823fcc4.noarch.rpm
openstack-keystone-doc-2014.1.3-fuel5.1.1.mira6.git.2958d54.823fcc4.noarch.rpm
python-keystone-2014.1.3-fuel5.1.1.mira6.git.2958d54.823fcc4.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable-5179/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.1~mira4+git.2958d54.823fcc4

Changeset: https://review.fuel-infra.org/5179
project: openstack/keystone
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
keystone-doc_2014.1.3-fuel5.1.1~mira4+git.2958d54.823fcc4_all.deb
keystone_2014.1.3-fuel5.1.1~mira4+git.2958d54.823fcc4_all.deb
python-keystone_2014.1.3-fuel5.1.1~mira4+git.2958d54.823fcc4_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.1-updates-stable-5179/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.1.mira6.git.2958d54.823fcc4

Changeset: https://review.fuel-infra.org/5179
project: openstack/keystone
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
openstack-keystone-2014.1.3-fuel5.1.1.mira6.git.2958d54.823fcc4.noarch.rpm
openstack-keystone-doc-2014.1.3-fuel5.1.1.mira6.git.2958d54.823fcc4.noarch.rpm
python-keystone-2014.1.3-fuel5.1.1.mira6.git.2958d54.823fcc4.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable-5179/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.2.mira6.git.e37d5a9.823fcc4

Changeset: https://review.fuel-infra.org/5178
project: openstack/keystone
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
openstack-keystone-2014.1.3-fuel5.1.2.mira6.git.e37d5a9.823fcc4.noarch.rpm
openstack-keystone-doc-2014.1.3-fuel5.1.2.mira6.git.e37d5a9.823fcc4.noarch.rpm
python-keystone-2014.1.3-fuel5.1.2.mira6.git.e37d5a9.823fcc4.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-5178/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.2.mira6.git.2b57b4d.823fcc4

Changeset: https://review.fuel-infra.org/5178
project: openstack/keystone
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backend initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
openstack-keystone-2014.1.3-fuel5.1.2.mira6.git.2b57b4d.823fcc4.noarch.rpm
openstack-keystone-doc-2014.1.3-fuel5.1.2.mira6.git.2b57b4d.823fcc4.noarch.rpm
python-keystone-2014.1.3-fuel5.1.2.mira6.git.2b57b4d.823fcc4.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-5178/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.2~mira4+git.2b57b4d.823fcc4

Changeset: https://review.fuel-infra.org/5178
project: openstack/keystone
branch: openstack-ci/fuel-5.1.2/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backend initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
keystone-doc_2014.1.3-fuel5.1.2~mira4+git.2b57b4d.823fcc4_all.deb
keystone_2014.1.3-fuel5.1.2~mira4+git.2b57b4d.823fcc4_all.deb
python-keystone_2014.1.3-fuel5.1.2~mira4+git.2b57b4d.823fcc4_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.2-stable-5178/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.1.mira6.git.ea65178.823fcc4

Changeset: https://review.fuel-infra.org/5179
project: openstack/keystone
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backends initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
openstack-keystone-2014.1.3-fuel5.1.1.mira6.git.ea65178.823fcc4.noarch.rpm
openstack-keystone-doc-2014.1.3-fuel5.1.1.mira6.git.ea65178.823fcc4.noarch.rpm
python-keystone-2014.1.3-fuel5.1.1.mira6.git.ea65178.823fcc4.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable-5179/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.1~mira4+git.ea65178.823fcc4

Changeset: https://review.fuel-infra.org/5179
project: openstack/keystone
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backends initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
keystone-doc_2014.1.3-fuel5.1.1~mira4+git.ea65178.823fcc4_all.deb
keystone_2014.1.3-fuel5.1.1~mira4+git.ea65178.823fcc4_all.deb
python-keystone_2014.1.3-fuel5.1.1~mira4+git.ea65178.823fcc4_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.1-updates-stable-5179/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.1.mira6.git.0274605.823fcc4

Changeset: https://review.fuel-infra.org/5179
project: openstack/keystone
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
openstack-keystone-2014.1.3-fuel5.1.1.mira6.git.0274605.823fcc4.noarch.rpm
openstack-keystone-doc-2014.1.3-fuel5.1.1.mira6.git.0274605.823fcc4.noarch.rpm
python-keystone-2014.1.3-fuel5.1.1.mira6.git.0274605.823fcc4.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.1-updates-stable-5179/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package keystone has been built for project openstack/keystone
Package version == 2014.1.3, package release == fuel5.1.1~mira4+git.0274605.823fcc4

Changeset: https://review.fuel-infra.org/5179
project: openstack/keystone
branch: openstack-ci/fuel-5.1.1-updates/2014.1.1
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
keystone-doc_2014.1.3-fuel5.1.1~mira4+git.0274605.823fcc4_all.deb
keystone_2014.1.3-fuel5.1.1~mira4+git.0274605.823fcc4_all.deb
python-keystone_2014.1.3-fuel5.1.1~mira4+git.0274605.823fcc4_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-5.1.1-updates-stable-5179/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.0.1.mira2.git.287f94d.0bb1113

Changeset: https://review.fuel-infra.org/5390
project: openstack/keystone
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backend initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
openstack-keystone-2014.2.2-fuel6.0.1.mira2.git.287f94d.0bb1113.noarch.rpm
openstack-keystone-doc-2014.2.2-fuel6.0.1.mira2.git.287f94d.0bb1113.noarch.rpm
python-keystone-2014.2.2-fuel6.0.1.mira2.git.287f94d.0bb1113.noarch.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-5390/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.0.1~mira2+git.287f94d.0bb1113

Changeset: https://review.fuel-infra.org/5390
project: openstack/keystone
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backend initialization after eventlet monkey-patching
status: patchset-created

Files placed on repository:
keystone-doc_2014.2.2-fuel6.0.1~mira2+git.287f94d.0bb1113_all.deb
keystone_2014.2.2-fuel6.0.1~mira2+git.287f94d.0bb1113_all.deb
python-keystone_2014.2.2-fuel6.0.1~mira2+git.287f94d.0bb1113_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable-5390/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.0.1.mira2

Changeset: https://review.fuel-infra.org/5390
project: openstack/keystone
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backend initialization after eventlet monkey-patching
status: change-merged

Files placed on repository:
openstack-keystone-2014.2.2-fuel6.0.1.mira2.noarch.rpm
openstack-keystone-doc-2014.2.2-fuel6.0.1.mira2.noarch.rpm
python-keystone-2014.2.2-fuel6.0.1.mira2.noarch.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package keystone has been built for project openstack/keystone
Package version == 2014.2.2, package release == fuel6.0.1~mira2

Changeset: https://review.fuel-infra.org/5390
project: openstack/keystone
branch: openstack-ci/fuel-6.0.1/2014.2
author: Alexander Makarov
committer: Alexander Makarov
subject: Place sql backend initialization after eventlet monkey-patching
status: change-merged

Files placed on repository:
keystone-doc_2014.2.2-fuel6.0.1~mira2_all.deb
keystone_2014.2.2-fuel6.0.1~mira2_all.deb
python-keystone_2014.2.2-fuel6.0.1~mira2_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0.1-stable/ubuntu

Revision history for this message
Leontii Istomin (listomin) wrote :

verified with 6.1-233

Changed in mos:
status: Fix Committed → Fix Released
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/keystone (openstack-ci/fuel-6.0-updates/2014.2)

Fix proposed to branch: openstack-ci/fuel-6.0-updates/2014.2
Change author: Alexander Makarov <email address hidden>
Review: https://review.fuel-infra.org/7109

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/keystone (openstack-ci/fuel-6.0-updates/2014.2)

Reviewed: https://review.fuel-infra.org/7109
Submitter: mos-infra-ci <>
Branch: openstack-ci/fuel-6.0-updates/2014.2

Commit: 4fde82a43936d6e00de3f60363ea96d254d34cee
Author: Alexander Makarov <email address hidden>
Date: Wed May 27 17:10:49 2015

Place sql backend initialization after eventlet monkey-patching

Change-Id: Ie443b4b3ff01b01e6666e43318569d2bdd02f518
Closes-Bug: #1425559
(cherry picked from commit 30e9eca64ad602c1ef773790aa13d1d7d2ce5457)
(cherry picked from commit 2b57b4def30d7624405f192abe9af579a80a5e81)
(cherry picked from commit 287f94d48fae23160201817954b884a967524c12)

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/keystone (openstack-ci/fuel-7.0/2015.1.0)

Fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Alexander Makarov <email address hidden>
Review: https://review.fuel-infra.org/8184

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/keystone (openstack-ci/fuel-7.0/2015.1.0)

Change abandoned by Alexander Makarov <email address hidden> on branch: openstack-ci/fuel-7.0/2015.1.0
Review: https://review.fuel-infra.org/8184

Roman Rufanov (rrufanov)
tags: added: customer-found support
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.