Ceph OSD Charm

  1. Bug #1783427
  2. Comment #3

Comment 3 for bug 1783427

Revision history for this message
Nikolay Vinogradov (nikolay.vinogradov) wrote :

This is not fixed. I just stepped on a reproduction of this:
     2019-10-31 16:04:39 DEBUG secrets-storage-relation-changed partx: /dev/disk/by-dname/osddata5: failed to read partition table
     2019-10-31 16:04:39 DEBUG juju-log secrets-storage:253: get partitions: []
     2019-10-31 16:04:39 DEBUG secrets-storage-relation-changed Failed to find physical volume "/dev/bcache6".
     2019-10-31 16:04:39 WARNING juju-log secrets-storage:253: Support for use of upstream ``apt_pkg`` module in conjunctionwith charm-helpers is deprecated since 2019-06-25
     2019-10-31 16:04:40 DEBUG secrets-storage-relation-changed DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 172.20.10.53
     2019-10-31 16:04:40 DEBUG secrets-storage-relation-changed DEBUG:urllib3.connectionpool:http://172.20.10.53:8200 "POST /v1/auth/approle/login HTTP/1.1" 200 500
     2019-10-31 16:04:40 DEBUG secrets-storage-relation-changed INFO:vaultlocker.dmcrypt:LUKS formatting /dev/disk/by-dname/osddata5 using UUID:861482d7-f7a7-4d97-83ee-95e4b892ed86
     2019-10-31 16:04:43 DEBUG secrets-storage-relation-changed INFO:vaultlocker.dmcrypt:udevadm trigger block/add for /dev/disk/by-dname/osddata5
     2019-10-31 16:04:43 DEBUG secrets-storage-relation-changed INFO:vaultlocker.dmcrypt:udevadm settle /dev/disk/by-uuid/861482d7-f7a7-4d97-83ee-95e4b892ed86
     2019-10-31 16:04:43 DEBUG secrets-storage-relation-changed DEBUG:urllib3.connectionpool:http://172.20.10.53:8200 "PUT /v1/charm-vaultlocker/ucs-4b-block-2/861482d7-f7a7-4d97-83ee-95e4b892ed86 HTTP/1.1" 204 0
     2019-10-31 16:04:43 DEBUG secrets-storage-relation-changed DEBUG:urllib3.connectionpool:http://172.20.10.53:8200 "GET /v1/charm-vaultlocker/ucs-4b-block-2/861482d7-f7a7-4d97-83ee-95e4b892ed86 HTTP/1.1" 200 866
     2019-10-31 16:04:43 DEBUG secrets-storage-relation-changed INFO:vaultlocker.dmcrypt:LUKS opening 861482d7-f7a7-4d97-83ee-95e4b892ed86
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed INFO:root:Enabling systemd unit for vaultlocker-decrypt@861482d7-f7a7-4d97-83ee-95e4b892ed86.service
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed Created symlink /etc/systemd/system/multi-user.target.wants/vaultlocker-decrypt@861482d7-f7a7-4d97-83ee-95e4b892ed86.service → /lib/systemd/system/vaultlocker-decrypt@.service.
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed 1+0 records in
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed 1+0 records out
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed 512 bytes copied, 0.000446392 s, 1.1 MB/s
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed Failed to find physical volume "/dev/mapper/crypt-861482d7-f7a7-4d97-83ee-95e4b892ed86".
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed INFO:root:Enabling systemd unit for vaultlocker-decrypt@861482d7-f7a7-4d97-83ee-95e4b892ed86.service
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed Created symlink /etc/systemd/system/multi-user.target.wants/vaultlocker-decrypt@861482d7-f7a7-4d97-83ee-95e4b892ed86.service → /lib/systemd/system/vaultlocker-decrypt@.service.
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed 1+0 records in
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed 1+0 records out
     2019-10-31 16:04:45 DEBUG secrets-storage-relation-changed 512 bytes copied, 0.000446392 s, 1.1 MB/s
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed Failed to find physical volume "/dev/mapper/crypt-861482d7-f7a7-4d97-83ee-95e4b892ed86".
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed WARNING: hfs signature detected on /dev/mapper/crypt-861482d7-f7a7-4d97-83ee-95e4b892ed86 at offset 1024. Wipe it? [y/n]: [n]
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed Aborted wiping of hfs.
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed 1 existing signature left on the device.
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed Traceback (most recent call last):
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/secrets-storage-relation-changed", line 874, in <module>
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed hooks.execute(sys.argv)
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/charmhelpers/core/hookenv.py", line 914, in execute
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed self._hooks[hook_name]()
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/secrets-storage-relation-changed", line 776, in secrets_storage_changed
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed prepare_disks_and_activate()
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/secrets-storage-relation-changed", line 546, in prepare_disks_and_activate
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed config('osd-encrypt-keymanager'))
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "lib/ceph/utils.py", line 1463, in osdize
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed bluestore, key_manager)
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "lib/ceph/utils.py", line 1538, in osdize_dev
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed key_manager)
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "lib/ceph/utils.py", line 1673, in _ceph_volume
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed key_manager=key_manager))
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "lib/ceph/utils.py", line 1923, in _allocate_logical_volume
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed lvm.create_lvm_physical_volume(pv_dev)
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/charmhelpers/contrib/storage/linux/lvm.py", line 92, in create_lvm_physical_volume
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed check_call(['pvcreate', block_device])
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed raise CalledProcessError(retcode, cmd)
     2019-10-31 16:04:46 DEBUG secrets-storage-relation-changed subprocess.CalledProcessError: Command '['pvcreate', '/dev/mapper/crypt-861482d7-f7a7-4d97-83ee-95e4b892ed86']' returned non-zero exit status 5.
     2019-10-31 16:04:46 ERROR juju.worker.uniter.operation runhook.go:132 hook "secrets-storage-relation-changed" failed: exit status 1