ceph-mon fails to deploy octopus

Bug #1864706 reported by Corey Bryant
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Ceph Monitor Charm
Fix Released
High
Frode Nordahl
charms.ceph
Fix Released
High
Frode Nordahl

Bug Description

On ussuri, bootstrap_manager() is failing with:

2020-02-25 19:40:20 INFO juju-log mon:3: Making dir /var/lib/ceph/mgr/ceph-juju-dc7ccd-coreycb-3 ceph:ceph 555
2020-02-25 19:40:20 DEBUG mon-relation-changed [errno 5] RADOS I/O error (error connecting to the cluster)
2020-02-25 19:40:20 DEBUG mon-relation-changed Traceback (most recent call last):
2020-02-25 19:40:20 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-0/charm/hooks/mon-relation-changed", line 1023, in <module>
2020-02-25 19:40:20 DEBUG mon-relation-changed hooks.execute(sys.argv)
2020-02-25 19:40:20 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-0/charm/hooks/charmhelpers/core/hookenv.py", line 934, in execute
2020-02-25 19:40:20 DEBUG mon-relation-changed self._hooks[hook_name]()
2020-02-25 19:40:20 DEBUG mon-relation-changed File "/var/lib/juju/agents/unit-ceph-mon-0/charm/hooks/mon-relation-changed", line 453, in mon_relation
2020-02-25 19:40:20 DEBUG mon-relation-changed ceph.bootstrap_manager()
2020-02-25 19:40:20 DEBUG mon-relation-changed File "lib/charms_ceph/utils.py", line 2937, in bootstrap_manager
2020-02-25 19:40:20 DEBUG mon-relation-changed keyring])
2020-02-25 19:40:20 DEBUG mon-relation-changed File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
2020-02-25 19:40:20 DEBUG mon-relation-changed raise CalledProcessError(retcode, cmd)
2020-02-25 19:40:20 DEBUG mon-relation-changed subprocess.CalledProcessError: Command '['ceph', 'auth', 'get-or-create', 'mgr.juju-dc7ccd-coreycb-3', 'mon', 'allow profile mgr', 'osd', 'allow *', 'mds', 'allow *', '--out-file', '/var/lib/ceph/mgr/ceph-juju-dc7ccd-coreycb-3/keyring']' returned non-zero exit status 1.
2020-02-25 19:40:21 ERROR juju.worker.uniter.operation runhook.go:132 hook "mon-relation-changed" failed: exit status 1

ubuntu@juju-dc7ccd-coreycb-3:/var/lib/juju/agents/unit-ceph-mon-0/charm$ ceph auth get-or-create mgr.juju-dc7ccd-coreycb-3 mon allow profile mgr osd allow * mds allow * --out-file /var/lib/ceph/mgr/ceph-juju-dc7ccd-coreycb-3/keyring
[errno 2] RADOS object not found (error connecting to the cluster)

Frode Nordahl (fnordahl)
Changed in charm-ceph-mon:
status: New → Triaged
Changed in charms.ceph:
status: New → Triaged
Changed in charm-ceph-mon:
importance: Undecided → High
Changed in charms.ceph:
importance: Undecided → High
Changed in charm-ceph-mon:
assignee: nobody → Frode Nordahl (fnordahl)
Changed in charms.ceph:
assignee: nobody → Frode Nordahl (fnordahl)
Changed in charm-ceph-mon:
status: Triaged → In Progress
Changed in charms.ceph:
status: Triaged → In Progress
Changed in charm-ceph-mon:
milestone: none → 20.05
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charms.ceph (master)

Fix proposed to branch: master
Review: https://review.opendev.org/710010

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-ceph-mon (master)

Fix proposed to branch: master
Review: https://review.opendev.org/710013

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charms.ceph (master)

Reviewed: https://review.opendev.org/710010
Committed: https://git.openstack.org/cgit/openstack/charms.ceph/commit/?id=6a00cf92e1f6d900af2a7d1c15e85c23f2a5469a
Submitter: Zuul
Branch: master

commit 6a00cf92e1f6d900af2a7d1c15e85c23f2a5469a
Author: Frode Nordahl <email address hidden>
Date: Wed Feb 26 11:27:35 2020 +0100

    Add newline at end of file when writing keyring

    Change-Id: If79977c2ec7588b09ca2e118141c7f3d9cf61767
    Closes-Bug: #1864706

Changed in charms.ceph:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-ceph-mon (master)

Reviewed: https://review.opendev.org/710013
Committed: https://git.openstack.org/cgit/openstack/charm-ceph-mon/commit/?id=478b98ac413d084d39b59517925457b685a5de9e
Submitter: Zuul
Branch: master

commit 478b98ac413d084d39b59517925457b685a5de9e
Author: Frode Nordahl <email address hidden>
Date: Wed Feb 26 11:28:20 2020 +0100

    Add newline at end of file when writing keyring

    Change-Id: I6682803c3dc67fd07f9db0073fe8eaa0de29c6d6
    Closes-Bug: #1864706
    Depends-On: If79977c2ec7588b09ca2e118141c7f3d9cf61767

Changed in charm-ceph-mon:
status: In Progress → Fix Committed
David Ames (thedac)
Changed in charm-ceph-mon:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.