Juju Charms Collection

keystone fails shared-db-relation-changed

Bug #1780157 reported by Ken Davis on 2018-07-04

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Juju Charms Collection	New	Undecided	Unassigned

Bug Description

The same error appears on Xenial using Ocata and Pike, any assistance would be greatly appreciated. Thanks in advance...

2018-07-02 22:48:17 DEBUG shared-db-relation-changed /usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py:182:
UserWarning: Using keystoneclient sessions has been deprecated. Please update your software to use keystoneauth1.
2018-07-02 22:48:17 DEBUG shared-db-relation-changed warnings.warn('Using keystoneclient sessions has been depreca
ted. '
2018-07-02 22:48:17 DEBUG worker.uniter.jujuc server.go:178 running hook tool "juju-log"
2018-07-02 22:48:17 INFO juju-log shared-db:14: Retrying '_ensure_initial_admin' 3 more times (delay=3)
2018-07-02 22:48:21 DEBUG worker.uniter.jujuc server.go:178 running hook tool "juju-log"
2018-07-02 22:48:21 INFO juju-log shared-db:14: Retrying '_ensure_initial_admin' 2 more times (delay=6)
2018-07-02 22:48:27 DEBUG worker.uniter.jujuc server.go:178 running hook tool "juju-log"
2018-07-02 22:48:27 INFO juju-log shared-db:14: Retrying '_ensure_initial_admin' 1 more times (delay=9)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed Traceback (most recent call last):
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/shared
-db-relation-changed", line 798, in <module>
2018-07-02 22:48:36 DEBUG shared-db-relation-changed main()
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/shared
-db-relation-changed", line 791, in main
2018-07-02 22:48:36 DEBUG shared-db-relation-changed hooks.execute(sys.argv)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmh
elpers/core/hookenv.py", line 823, in execute
2018-07-02 22:48:36 DEBUG shared-db-relation-changed self._hooks[hook_name]()
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmh
elpers/contrib/openstack/utils.py", line 1453, in wrapped_f
2018-07-02 22:48:36 DEBUG shared-db-relation-changed restart_functions)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmh
elpers/core/host.py", line 730, in restart_on_change_helper
2018-07-02 22:48:36 DEBUG shared-db-relation-changed r = lambda_f()
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmh
elpers/contrib/openstack/utils.py", line 1452, in <lambda>
2018-07-02 22:48:36 DEBUG shared-db-relation-changed (lambda: f(*args, **kwargs)), restart_map, stopstart,
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/shared
-db-relation-changed", line 348, in db_changed
2018-07-02 22:48:36 DEBUG shared-db-relation-changed leader_init_db_if_ready(use_current_context=True)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/shared
-db-relation-changed", line 323, in leader_init_db_if_ready
2018-07-02 22:48:36 DEBUG shared-db-relation-changed update_all_identity_relation_units(check_db_ready=False)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/shared
-db-relation-changed", line 279, in update_all_identity_relation_units
2018-07-02 22:48:36 DEBUG shared-db-relation-changed ensure_initial_admin(config)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/keysto
ne_utils.py", line 1181, in ensure_initial_admin
2018-07-02 22:48:36 DEBUG shared-db-relation-changed return _ensure_initial_admin(config)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmh
elpers/core/decorators.py", line 40, in _retry_on_exception_inner_2
2018-07-02 22:48:36 DEBUG shared-db-relation-changed return f(*args, **kwargs)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/keysto
ne_utils.py", line 1136, in _ensure_initial_admin
2018-07-02 22:48:36 DEBUG shared-db-relation-changed create_tenant("admin", DEFAULT_DOMAIN)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/keysto
ne_utils.py", line 864, in create_tenant
2018-07-02 22:48:36 DEBUG shared-db-relation-changed manager = get_manager()
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/keysto
ne_utils.py", line 953, in get_manager
2018-07-02 22:48:36 DEBUG shared-db-relation-changed api_version)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmh
elpers/core/decorators.py", line 40, in _retry_on_exception_inner_2
2018-07-02 22:48:36 DEBUG shared-db-relation-changed return f(*args, **kwargs)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/manage
r.py", line 75, in get_keystone_manager
2018-07-02 22:48:36 DEBUG shared-db-relation-changed for svc in manager.api.services.list():
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/usr/lib/python2.7/dist-packages/keystoneclient/v2_0/se
rvices.py", line 35, in list
2018-07-02 22:48:36 DEBUG shared-db-relation-changed return self._list("/OS-KSADM/services", "OS-KSADM:services"
)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/usr/lib/python2.7/dist-packages/keystoneclient/base.py
", line 125, in _list
2018-07-02 22:48:36 DEBUG shared-db-relation-changed resp, body = self.client.get(url, **kwargs)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.
py", line 288, in get
2018-07-02 22:48:36 DEBUG shared-db-relation-changed return self.request(url, 'GET', **kwargs)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.
py", line 447, in request
2018-07-02 22:48:36 DEBUG shared-db-relation-changed resp = super(LegacyJsonAdapter, self).request(*args, **kwar
gs)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.
py", line 192, in request
2018-07-02 22:48:36 DEBUG shared-db-relation-changed return self.session.request(url, method, **kwargs)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/usr/lib/python2.7/dist-packages/positional/__init__.py
", line 101, in inner
2018-07-02 22:48:36 DEBUG shared-db-relation-changed return wrapped(*args, **kwargs)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed File "/usr/lib/python2.7/dist-packages/keystoneclient/session
.py", line 445, in request
2018-07-02 22:48:36 DEBUG shared-db-relation-changed raise exceptions.from_response(resp, method, url)
2018-07-02 22:48:36 DEBUG shared-db-relation-changed keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (
HTTP 504)
2018-07-02 22:48:36 ERROR juju.worker.uniter.operation runhook.go:113 hook "shared-db-relation-changed" failed: exit
status 1

Revision history for this message

Ken Davis (jkdavis1) wrote on 2018-07-04:

Download full text (8.3 KiB)

This is the current environment that is deployed and everything seems to be working with the exception of keystone.

This is the current environment that is deployed and everything seems to be working with the exception of keystone.

series: xenial
applications:
  rabbitmq-server:
    charm: 'cs:~openstack-charmers-next/rabbitmq-server-293'
    num_units: 1
    annotations:
      gui-x: '1572'
      gui-y: '351.50000000000006'
    to:
      - 'lxd:nova-compute/1'
  neutron-gateway:
    charm: 'cs:~openstack-charmers-next/neutron-gateway-324'
    num_units: 1
    options:
      bridge-mappings: 'ph-eth1:br-eth1'
      data-port: 'br-eth1:eth1'
      enable-l3-agent: false
      openstack-origin: 'cloud:xenial-pike'
      worker-multiplier: 0.25
    annotations:
      gui-x: '1172'
      gui-y: '-341.3203230275508'
    to:
      - '4'
  glance:
    charm: 'cs:~openstack-charmers-next/glance-315'
    num_units: 1
    options:
      openstack-origin: 'cloud:xenial-pike'
      worker-multiplier: 0.25
    annotations:
      gui-x: '972'
      gui-y: '697.9101615137755'
    to:
      - 'lxd:nova-compute/1'
  ceph-mon:
    charm: 'cs:~openstack-charmers-next/ceph-mon-331'
    num_units: 3
    options:
      expected-osd-count: 3
      source: 'cloud:xenial-pike'
    annotations:
      gui-x: '172'
      gui-y: '5.089838486224551'
    to:
      - 'lxd:nova-compute/1'
      - 'lxd:nova-compute/2'
      - 'lxd:nova-compute/3'
  percona-cluster:
    charm: 'cs:~openstack-charmers-next/percona-cluster-301'
    num_units: 1
    options:
      innodb-buffer-pool-size: 256M
      max-connections: 20000
      root-password: ubuntu123
    annotations:
      gui-x: '1172'
      gui-y: '351.50000000000006'
    to:
      - 'lxd:nova-compute/3'
  neutron-api:
    charm: 'cs:~openstack-charmers-next/neutron-api-344'
    num_units: 1
    options:
      config-flags: max_fixed_ips_per_port=100
      flat-network-providers: physnet1
      neutron-security-groups: true
      openstack-origin: 'cloud:xenial-pike'
      quota-floatingip: 100
      quota-network: 24
      quota-port: 192
      quota-security-group: -1
      quota-security-group-rule: -1
      quota-subnet: 48
      vlan-ranges: 'ph-eth0:2:4000 ph-eth1:2:4000 ph-eth3:2:4000'
      worker-multiplier: 0.25
    annotations:
      gui-x: '1372'
      gui-y: '5.0898384862246075'
    to:
      - 'lxd:nova-compute/1'
  ntp:
    charm: 'cs:~openstack-charmers-next/ntp-1'
    annotations:
      gui-x: '372'
      gui-y: '1044.3203230275508'
  cinder-ceph:
    charm: 'cs:~openstack-charmers-next/cinder-ceph-262'
    annotations:
      gui-x: '572'
      gui-y: '697.9101615137755'
  ceph-radosgw:
    charm: 'cs:~openstack-charmers-next/ceph-radosgw-286'
    num_units: 1
    options:
      source: 'cloud:xenial-pike'
    annotations:
      gui-x: '572'
      gui-y: '5.0898384862246075'
    to:
      - 'lxd:nova-compute/2'
  nova-compute:
    charm: 'cs:~openstack-charmers-next/nova-compute-374'
    num_units: 8
    options:
      config-flags: default_ephemeral_format=ext4
      enable-live-migration: true
      enable-resize: true
      openstack-origin: 'cloud:xenial-pike'
    annotations:
      gui-x: '172'
      gui-y: '697.9101615137754'
    to:
      - '0'
      - '1'
      - '2'
      - '3'
      - '4'
      - '5'
      - '6'
      - '7'
  neutron-openvswitch:
    charm: 'cs:~openstack-charmers-next/neutron-openvswitch-305'
    options:
      bridge-mappings: 'ph-eth0:br-eth0 ph-eth1:br-eth1 ph-eth3:br-eth3'
      data-port: 'br-eth0:eth0 br-eth1:eth1 br-eth3:eth3'
      vlan-ranges: 'ph-eth0:2:4000 ph-eth1:2:4000 ph-eth3:2:4000'
    annotations:
      gui-x: '-28'
      gui-y: '351.5'
  heat:
    charm: 'cs:heat-252'
    num_units: 1
    annotations:
      gui-x: '1372'
      gui-y: '697.9101615137755'
    to:
      - 'lxd:nova-compute/3'
  ceph-osd:
    charm: 'cs:~openstack-charmers-next/ceph-osd-344'
    num_units: 3
    options:
      osd-devices: /dev/sdb
      source: 'cloud:xenial-pike'
    annotations:
      gui-x: '372'
      gui-y: '-341.3203230275508'
    to:
      - '0'
      - '1'
      - '7'
  nova-cloud-controller:
    charm: 'cs:~openstack-charmers-next/nova-cloud-controller-354'
    num_units: 1
    options:
      console-access-protocol: spice
      cpu-allocation-ratio: 1
      network-manager: Neutron
      openstack-origin: 'cloud:xenial-pike'
      worker-multiplier: 0.25
    annotations:
      gui-x: '772'
      gui-y: '-341.3203230275508'
    to:
      - 'lxd:nova-compute/3'
  openstack-dashboard:
    charm: 'cs:~openstack-charmers-next/openstack-dashboard-317'
    num_units: 1
    options:
      openstack-origin: 'cloud:xenial-pike'
    annotations:
      gui-x: '972'
      gui-y: '5.0898384862246075'
    to:
      - 'lxd:nova-compute/2'
  cinder:
    charm: 'cs:~openstack-charmers-next/cinder-325'
    num_units: 1
    options:
      block-device: None
      glance-api-version: 2
      openstack-origin: 'cloud:xenial-pike'
      worker-multiplier: 0.25
    annotations:
      gui-x: '372'
      gui-y: '351.50000000000006'
    to:
      - 'lxd:nova-compute/2'
  keystone:
    charm: 'cs:~openstack-charmers-next/keystone-356'
    num_units: 1
    options:
      admin-password: h0r1z0n
      openstack-origin: 'cloud:xenial-pike'
      worker-multiplier: 0.25
    annotations:
      gui-x: '772'
      gui-y: '351.50000000000006'
    to:
      - 'lxd:nova-compute/1'
relations:
  - - 'nova-compute:amqp'
    - 'rabbitmq-server:amqp'
  - - 'nova-cloud-controller:amqp'
    - 'rabbitmq-server:amqp'
  - - 'neutron-api:amqp'
    - 'rabbitmq-server:amqp'
  - - 'nova-cloud-controller:image-service'
    - 'glance:image-service'
  - - 'neutron-openvswitch:amqp'
    - 'rabbitmq-server:amqp'
  - - 'nova-compute:neutron-plugin'
    - 'neutron-openvswitch:neutron-plugin'
  - - 'neutron-openvswitch:neutron-plugin-api'
    - 'neutron-api:neutron-plugin-api'
  - - 'nova-cloud-controller:cloud-compute'
    - 'nova-compute:cloud-compute'
  - - 'neutron-api:shared-db'
    - 'percona-cluster:shared-db'
  - - 'nova-cloud-controller:identity-service'
    - 'keystone:identity-service'
  - - 'cinder:identity-service'
    - 'keystone:identity-service'
  - - 'glance:identity-service'
    - 'keystone:identity-service'
  - - 'openstack-dashboard:identity-service'
    - 'keystone:identity-service'
  - - 'nova-compute:image-service'
    - 'glance:image-service'
  - - 'nova-cloud-controller:neutron-api'
    - 'neutron-api:neutron-api'
  - - 'cinder-ceph:storage-backend'
    - 'cinder:storage-backend'
  - - 'glance:shared-db'
    - 'percona-cluster:shared-db'
  - - 'nova-cloud-controller:quantum-network-service'
    - 'neutron-gateway:quantum-network-service'
  - - 'ceph-mon:client'
    - 'cinder-ceph:ceph'
  - - 'neutron-gateway:neutron-plugin-api'
    - 'neutron-api:neutron-plugin-api'
  - - 'nova-cloud-controller:shared-db'
    - 'percona-cluster:shared-db'
  - - 'ntp:juju-info'
    - 'neutron-gateway:juju-info'
  - - 'cinder:cinder-volume-service'
    - 'nova-cloud-controller:cinder-volume-service'
  - - 'ntp:juju-info'
    - 'nova-compute:juju-info'
  - - 'cinder:amqp'
    - 'rabbitmq-server:amqp'
  - - 'ceph-mon:client'
    - 'nova-compute:ceph'
  - - 'ceph-mon:client'
    - 'glance:ceph'
  - - 'cinder:image-service'
    - 'glance:image-service'
  - - 'ceph-radosgw:mon'
    - 'ceph-mon:radosgw'
  - - 'ceph-osd:mon'
    - 'ceph-mon:osd'
  - - 'cinder:shared-db'
    - 'percona-cluster:shared-db'
  - - 'heat:shared-db'
    - 'percona-cluster:shared-db'
  - - 'heat:amqp'
    - 'rabbitmq-server:amqp'
  - - 'heat:identity-service'
    - 'keystone:identity-service'
  - - 'ceph-radosgw:identity-service'
    - 'keystone:identity-service'
  - - 'keystone:shared-db'
    - 'percona-cluster:shared-db'
  - - 'neutron-gateway:amqp'
    - 'rabbitmq-server:amqp'
  - - 'neutron-api:identity-service'
    - 'keystone:identity-service'
  - - 'glance:amqp'
    - 'rabbitmq-server:amqp'
  - - 'nova-compute:ceph-access'
    - 'cinder-ceph:ceph-access'
machines:
  '0':
    series: xenial
    constraints: arch=amd64 cpu-cores=16 mem=65536
  '1':
    series: xenial
    constraints: arch=amd64 cpu-cores=24 mem=65536
  '2':
    series: xenial
    constraints: arch=amd64 cpu-cores=24 mem=65536
  '3':
    series: xenial
    constraints: arch=amd64 cpu-cores=24 mem=65536
  '4':
    series: xenial
    constraints: arch=amd64 cpu-cores=24 mem=131072
  '5':
    series: xenial
    constraints: arch=amd64 cpu-cores=24 mem=65536
  '6':
    series: xenial
    constraints: arch=amd64 cpu-cores=24 mem=65536
  '7':
    series: xenial
    constraints: arch=amd64 cpu-cores=24 mem=65536

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.