is_mapped_lux_device fails on AWS

Bug #1782398 reported by Mike Wilson
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ceph OSD Charm
Triaged
High
Unassigned

Bug Description

unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed partx: /dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol048217c0729110399: failed to read partition table
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.juju-log mon:14: get partitions: []
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed Failed to find physical volume "/dev/nvme2n1".
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed Traceback (most recent call last):
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 642, in <module>
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed hooks.execute(sys.argv)
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/charmhelpers/core/hookenv.py", line 823, in execute
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed self._hooks[hook_name]()
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 537, in mon_relation
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed prepare_disks_and_activate()
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 461, in prepare_disks_and_activate
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed config('osd-encrypt-keymanager'))
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1413, in osdize
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed bluestore, key_manager)
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1470, in osdize_dev
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed if is_mapped_luks_device(dev):
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1704, in is_mapped_luks_device
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed .format(os.path.basename(dev))))
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed StopIteration

ubuntu@ip-172-31-20-91:~$ ls /sys/class/block/nvme2n1/holders/
ubuntu@ip-172-31-20-91:~$

This is an empty directory on AWS.

Deployed with:

juju deploy -n 3 ceph-mon
juju deploy -n 3 ceph-osd --storage osd-devices=ebs,32G,2 --storage osd-journals=ebs,8G,1

juju add-relation ceph-mon ceph-osd

Mike Wilson (knobby)
description: updated
Revision history for this message
Chris MacNaughton (chris.macnaughton) wrote :
Download full text (7.8 KiB)

When I try to deploy onto AWS (on Xenial), I get more errors:

2018-08-21 13:51:18 DEBUG mon-relation-changed Failed to find physical volume "/dev/xvdh".
2018-08-21 13:51:27 DEBUG juju-log mon:1: get partitions: ['1 2048 2099199 2097152 1G ceph\\x20journal f3a44a58-977f-485f-af46-2e9d3a287eaf']
2018-08-21 13:51:27 DEBUG juju-log mon:1: get partitions: ['1 2048 2099199 2097152 1G ceph\\x20journal 29393ee0-8e3d-46c9-8f19-6ca46640769f']
2018-08-21 13:51:27 INFO juju-log mon:1: osdize cmd: ['ceph-disk', 'prepare', '--fs-type', 'xfs', '/dev/xvdh', '/dev/xvdg']
2018-08-21 13:51:28 DEBUG mon-relation-changed prepare_device: OSD will not be hot-swappable if journal is not the same device as the osd data
2018-08-21 13:51:28 DEBUG mon-relation-changed Could not create partition 2 from 2099200 to 4196351
2018-08-21 13:51:28 DEBUG mon-relation-changed Setting name!
2018-08-21 13:51:28 DEBUG mon-relation-changed partNum is 1
2018-08-21 13:51:28 DEBUG mon-relation-changed REALLY setting name!
2018-08-21 13:51:28 DEBUG mon-relation-changed Unable to set partition 2's name to 'ceph journal'!
2018-08-21 13:51:28 DEBUG mon-relation-changed Could not change partition 2's type code to 45b0969e-9b03-4f30-b4c6-b4b80ceff106!
2018-08-21 13:51:28 DEBUG mon-relation-changed Error encountered; not saving changes.
2018-08-21 13:51:28 DEBUG mon-relation-changed Traceback (most recent call last):
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/sbin/ceph-disk", line 9, in <module>
2018-08-21 13:51:28 DEBUG mon-relation-changed load_entry_point('ceph-disk==1.0.0', 'console_scripts', 'ceph-disk')()
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 5372, in run
2018-08-21 13:51:28 DEBUG mon-relation-changed main(sys.argv[1:])
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 5325, in main
2018-08-21 13:51:28 DEBUG mon-relation-changed main_catch(args.func, args)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 5350, in main_catch
2018-08-21 13:51:28 DEBUG mon-relation-changed func(args)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1900, in main
2018-08-21 13:51:28 DEBUG mon-relation-changed Prepare.factory(args).prepare()
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1889, in prepare
2018-08-21 13:51:28 DEBUG mon-relation-changed self.prepare_locked()
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 1920, in prepare_locked
2018-08-21 13:51:28 DEBUG mon-relation-changed self.data.prepare(self.journal)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2588, in prepare
2018-08-21 13:51:28 DEBUG mon-relation-changed self.prepare_device(*to_prepare_list)
2018-08-21 13:51:28 DEBUG mon-relation-changed File "/usr/lib/python2.7/dist-packages/ceph_disk/main.py", line 2750, in prepare_device
201...

Read more...

Changed in charm-ceph-osd:
status: New → Triaged
importance: Undecided → High
Revision history for this message
Mike Wilson (knobby) wrote :

Note that version 263 was the last on that worked. I can still deploy with:

juju deploy -n 3 ceph-mon
juju deploy -n 3 cs:ceph-osd-263 --storage osd-devices=ebs,32G,2 --storage osd-journals=ebs,8G,1

juju add-relation ceph-mon ceph-osd

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.