is_mapped_lux_device fails on AWS

[Mike Wilson]

unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed partx: /dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol048217c0729110399: failed to read partition table
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.juju-log mon:14: get partitions: []
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed Failed to find physical volume "/dev/nvme2n1".
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed Traceback (most recent call last):
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 642, in <module>
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed hooks.execute(sys.argv)
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/charmhelpers/core/hookenv.py", line 823, in execute
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed self._hooks[hook_name]()
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 537, in mon_relation
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed prepare_disks_and_activate()
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 461, in prepare_disks_and_activate
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed config('osd-encrypt-keymanager'))
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1413, in osdize
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed bluestore, key_manager)
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1470, in osdize_dev
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed if is_mapped_luks_device(dev):
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1704, in is_mapped_luks_device
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed .format(os.path.basename(dev))))
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed StopIteration

ubuntu@ip-172-31-20-91:~$ ls /sys/class/block/nvme2n1/holders/
ubuntu@ip-172-31-20-91:~$

This is an empty directory on AWS.

Deployed with:

juju deploy -n 3 ceph-mon
juju deploy -n 3 ceph-osd --storage osd-devices=ebs,32G,2 --storage osd-journals=ebs,8G,1

juju add-relation ceph-mon ceph-osd

[Chris MacNaughton (chris.macnaughton)]

When I try to deploy onto AWS (on Xenial), I get more errors:

2018-08-21 13:51:18 DEBUG mon-relation-changed Failed to find physical volume "/dev/xvdh".
2018-08-21 13:51:27 DEBUG juju-log mon:1: get partitions: ['1 2048 2099199 2097152 1G ceph\\x20journal f3a44a58-977f-485f-af46-2e9d3a287eaf']
2018-08-21 13:51:27 DEBUG juju-log mon:1: get partitions: ['1 2048 2099199 2097152 1G ceph\\x20journal 29393ee0-8e3d-46c9-8f19-6ca46640769f']
2018-08-21 13:51:27 INFO juju-log mon:1: osdize cmd: ['ceph-disk', 'prepare', '--fs-type', 'xfs', '/dev/xvdh', '/dev/xvdg']
2018-08-21 13:51:28 DEBUG mon-relation-changed prepare_device: OSD will not be hot-swappable if journal is not the same device as the osd data
2018-08-21 13:51:28 DEBUG mon-relation-changed Could not create partition 2 from 2099200 to 4196351
2018-08-21 13:51:28 DEBUG mon-relation-changed Setting name!
2018-08-21 13:51:28 DEBUG mon-relation-changed partNum is 1
2018-08-21 13:51:28 DEBUG mon-relation-changed REALLY setting name!
2018-08-21 13:51:28 DEBUG mon-relation-changed Unable to set partition 2's name to 'ceph journal'!
2018-08-21 13:51:28 DEBUG mon-relation-changed Could not change partition 2's type code to 45b0969e-9b03-4f30-b4c6-b4b80ceff106!
2018-08-21 13:51:28 DEBUG mon-relation-changed Error encountered; not saving changes.
2018-08-21 13:51:28 DEBUG mon-relation-changed Traceback (most recent call last):
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/sbin/ceph-disk", line 9, in <module>
2018-08-21 13:51:28 DEBUG mon-relation-changed load_entry_point('ceph-disk==1.0.0', 'console_scripts', 'ceph-disk')()
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 5372, in run
2018-08-21 13:51:28 DEBUG mon-relation-changed main(sys.argv[1:])
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 5325, in main
2018-08-21 13:51:28 DEBUG mon-relation-changed main_catch(args.func, args)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 5350, in main_catch
2018-08-21 13:51:28 DEBUG mon-relation-changed func(args)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1900, in main
2018-08-21 13:51:28 DEBUG mon-relation-changed Prepare.factory(args).prepare()
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1889, in prepare
2018-08-21 13:51:28 DEBUG mon-relation-changed self.prepare_locked()
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1920, in prepare_locked
2018-08-21 13:51:28 DEBUG mon-relation-changed self.data.prepare(self.journal)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2588, in prepare
2018-08-21 13:51:28 DEBUG mon-relation-changed self.prepare_device(*to_prepare_list)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2750, in prepare_device
201...

[Mike Wilson (knobby)]

Note that version 263 was the last on that worked. I can still deploy with:

juju deploy -n 3 ceph-mon
juju deploy -n 3 cs:ceph-osd-263 --storage osd-devices=ebs,32G,2 --storage osd-journals=ebs,8G,1

juju add-relation ceph-mon ceph-osd