ceph-mon unit stays in "Bootstrapping MON cluster" workload state
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Ceph Monitor Charm |
Fix Released
|
High
|
Frode Nordahl | ||
OpenStack Ceph Charm (Retired) |
Won't Fix
|
High
|
Unassigned |
Bug Description
Deploys of openstack-base occasionally fail with ceph-mon/0 ending in this state:
ceph-mon/0:
current: maintenance
message: Bootstrapping MON cluster
since: 24 Sep 2017 01:15:49Z
current: executing
message: running mon-relation-
since: 24 Sep 2017 01:15:44Z
version: 2.2.4
machine: 1/lxd/0
There are some errors like this in the unit's log:
2017-09-24 01:16:31 DEBUG mon-relation-
2017-09-24 01:16:31 DEBUG mon-relation-
2017-09-24 01:16:31 DEBUG mon-relation-
2017-09-24 01:16:31 DEBUG mon-relation-
I've attached a juju crashdump tarball with full logs
This was run with cs:openstack/base on September 24.
Changed in charm-ceph-mon: | |
assignee: | nobody → Chris MacNaughton (chris.macnaughton) |
Changed in charm-ceph-mon: | |
status: | New → Triaged |
importance: | Undecided → High |
Changed in charm-ceph: | |
assignee: | nobody → Chris MacNaughton (chris.macnaughton) |
status: | New → In Progress |
importance: | Undecided → High |
Changed in charm-ceph: | |
status: | Incomplete → New |
Changed in charm-ceph: | |
status: | New → In Progress |
Changed in charm-ceph-mon: | |
status: | New → In Progress |
tags: | added: stable-backport sts |
Changed in charm-ceph-mon: | |
milestone: | none → 18.05 |
Changed in charm-ceph: | |
assignee: | Chris MacNaughton (chris.macnaughton) → nobody |
Changed in charm-ceph-mon: | |
status: | Fix Committed → Fix Released |
Changed in charm-ceph-mon: | |
status: | Fix Released → New |
Changed in charm-ceph-mon: | |
status: | New → In Progress |
milestone: | 18.02 → 18.05 |
Changed in charm-ceph-mon: | |
status: | Fix Committed → Fix Released |
The unit that is stuck in bootstrapping seems to have managed to fail to correctly create its admin keyring as the file `/etc/ceph/ ceph.client. admin.keyring` is empty, rather than containing the keyring as it should. This file is created by the ceph command `ceph-authtool $keyring --create-keyring --name=mon. --add-key=$secret --cap 'mon' 'allow *'`