Ceph deployment failed with ceph auth error auth add client.compute --in-file=/etc/ceph/ceph.client.compute.keyring returned 1 instead of one of [0]
Bug #1578566 reported by
Tatyanka
This bug affects 2 people
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Fix Committed
|
Critical
|
Oleksiy Molchanov |
Bug Description
Scenario:
1. Create cluster
2. Add 3 nodes with controller and ceph OSD roles
3. Add 2 nodes with compute
4. Deploy the cluster
5. Run OSTF
Actual:
ceph-compute task failed on both compute nodes:
http://
iso: 164
Reproduced regurally on fuel-ci:
https:/
https:/
https:/
Changed in fuel: | |
assignee: | MOS Puppet Team (mos-puppet) → MOS Ceph (mos-ceph) |
status: | New → Confirmed |
Changed in fuel: | |
assignee: | MOS Puppet Team (mos-puppet) → Oleksiy Molchanov (omolchanov) |
no longer affects: | fuel/mitaka |
no longer affects: | fuel/newton |
To post a comment you must log in.
> 2. Add 3 nodes with controller and ceph OSD roles
First of all deploying ceph OSD and monitor onto the same node is not supported [1]
(although it's possible to setup ceph that way manually for testing/development purposes).
2016-05-05 01:29:36 +0000 /Stage[ main]/Ceph: :Osds/Ceph: :Osd[/dev/ vdc3]/Exec[ ceph-osd- prepare- /dev/vdc3] /returns (notice): Error: Partition(s) 1 on /dev/vdc3 have been written, but we have been unable to inform the kernel of the change, probably because it/they are in use. As a result, the old partition(s) will remain in use. You should reboot now before making further changes. main]/Ceph: :Osds/Ceph: :Osd[/dev/ vdc3]/Exec[ ceph-osd- prepare- /dev/vdc3] /returns (notice): + udevadm settle
2016-05-05 01:29:36 +0000 /Stage[
Secondly it looks like Fuel tries to alter auth rules before fetching the client.admin keyring:
$ ls -1 node-2/etc/ceph/ compute. keyring
ceph.client.
ceph.conf
rbdmap
There's no ceph.client. admin.keyring so any ceph command is deemed to fail:
2016-05- 05T01:30: 26.898433+ 00:00 notice: (/Stage[ main]/Osnailyfa cter::Ceph: :Ceph_compute/ Ceph::Key[ client. compute] /Exec[ceph- injectkey- client. compute] /returns) + ceph auth add client.compute --in-file= /etc/ceph/ ceph.client. compute. keyring 05T01:30: 26.898433+ 00:00 notice: (/Stage[ main]/Osnailyfa cter::Ceph: :Ceph_compute/ Ceph::Key[ client. compute] /Exec[ceph- injectkey- client. compute] /returns) 2016-05-05 01:30:26.873878 7f5d717d5700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 05T01:30: 26.898433+ 00:00 notice: (/Stage[ main]/Osnailyfa cter::Ceph: :Ceph_compute/ Ceph::Key[ client. compute] /Exec[ceph- injectkey- client. compute] /returns) 2016-05-05 01:30:26.873957 7f5d717d5700 0 librados: client.admin initialization error (2) No such file or directory 05T01:30: 26.898433+ 00:00 notice: (/Stage[ main]/Osnailyfa cter::Ceph: :Ceph_compute/ Ceph::Key[ client. compute] /Exec[ceph- injectkey- client. compute] /returns) Error connecting to cluster: ObjectNotFound
2016-05-
2016-05-
2016-05-
[1] http:// docs.ceph. com/docs/ hammer/ start/hardware- recommendations /#hard- disk-drives