root@node-5:~# lsblk -ln
sda              8:0    0 279.4G  0 disk
sda1             8:1    0    24M  0 part
sda2             8:2    0   200M  0 part
sda3             8:3    0   200M  0 part /boot
sda4             8:4    0  66.1G  0 part
os-root (dm-0) 252:0    0    50G  0 lvm  /
os-swap (dm-1) 252:1    0    16G  0 lvm  [SWAP]
sda5             8:5    0    20M  0 part
sdb              8:16   0   1.1T  0 disk
sdb1             8:17   0    24M  0 part
sdb2             8:18   0   200M  0 part
sdb3             8:19   0   1.1T  0 part
sdc              8:32   0   1.1T  0 disk
sdc1             8:33   0    24M  0 part
sdc2             8:34   0   200M  0 part
sdc3             8:35   0   1.1T  0 part
sdd              8:48   0   1.1T  0 disk
sdd1             8:49   0    24M  0 part
sdd2             8:50   0   200M  0 part
sdd3             8:51   0   1.1T  0 part
sde              8:64   0   1.1T  0 disk
sde1             8:65   0    24M  0 part
sde2             8:66   0   200M  0 part
sde3             8:67   0   1.1T  0 part
sdf              8:80   0   1.1T  0 disk
sdf1             8:81   0    24M  0 part
sdf2             8:82   0   200M  0 part
sdf3             8:83   0   1.1T  0 part
sdg              8:96   0  93.1G  0 disk
sdg1             8:97   0    24M  0 part
sdg2             8:98   0   200M  0 part
sdg3             8:99   0    10G  0 part
sdg4             8:100  0    10G  0 part
sdg5             8:101  0    10G  0 part
sdg6             8:102  0    10G  0 part
sdg7             8:103  0    10G  0 part


Claude

2015-05-12 3:03 GMT-04:00 Mykola Golub <email address hidden>:

> It looks like ceph-deploy was feed with empty journal name:
>
>   ceph-deploy osd prepare node-5:/dev/sdb3:
>
> There should not be ':' at the end.
>
> ClaudeD, could you please show the output of  this command:
>
>   lsblk -ln
>
> on the osd host after failed deployment?
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1453959
>
> Title:
>   Can't deploy Ceph with disk dedicated for journal in Fuel 6.1
>
> Status in Fuel: OpenStack installer that works:
>   New
>
> Bug description:
>   Environment:
>
>   {"build_id": "2015-05-08_05-40-59", "build_number": "223",
>   "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id":
>   "2015-05-08_05-40-59", "build_number": "223", "api": "1.0", "fuel-
>   library_sha": "53ce3081a4dfda2995232714de7d17e6edf6e97d",
>   "nailgun_sha": "ca9c91abed5e5b0671f4c514f7efd47eb5ca501c",
>   "feature_groups": ["experimental"], "openstack_version":
>   "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha":
>   "af6c9c3799b9ec107bcdc6dbf035cafc034526ce", "astute_sha":
>   "6a4dcd11c67af2917815f3678fb594c7412a4c97", "fuel-ostf_sha":
>   "740ded337bb2a8a9b3d505026652512257375c01", "release": "6.1",
>   "fuelmain_sha": "43b890efe560ab65dd748b8c2d7bd7d7cb0649e3"}}},
>   "auth_required": true, "api": "1.0", "fuel-library_sha":
>   "53ce3081a4dfda2995232714de7d17e6edf6e97d", "nailgun_sha":
>   "ca9c91abed5e5b0671f4c514f7efd47eb5ca501c", "feature_groups":
>   ["experimental"], "openstack_version": "2014.2.2-6.1", "production":
>   "docker", "python-fuelclient_sha":
>   "af6c9c3799b9ec107bcdc6dbf035cafc034526ce", "astute_sha":
>   "6a4dcd11c67af2917815f3678fb594c7412a4c97", "fuel-ostf_sha":
>   "740ded337bb2a8a9b3d505026652512257375c01", "release": "6.1",
>   "fuelmain_sha": "43b890efe560ab65dd748b8c2d7bd7d7cb0649e3"}
>
>   Steps to reproduce:
>
>   -Create environment with Juno on Ubuntu 14.04, KVM, Neutron with vlan
> seg., and Ceph for Cinder and Glance
>   -Deploy 3 controller nodes, 3 compute nodes and 3 Ceph nodes; each Ceph
> node has 5 hdd for data and 1 ssd for journal (Ceph repl. factor = 3)
>   -Deployment fails on all 3 Ceph nodes with the following error :
>
>   2015-05-11 19:24:39   ERR
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) change from notrun to 0 failed:
> ceph-deploy osd prepare node-5:/dev/sdb3: returned 1 instead of one of [0]
>   2015-05-11 19:24:39   ERR
>    /usr/bin/puppet:4:in `<main>'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:91:in `execute'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:137:in `run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:478:in `exit_on_fail'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `block in run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:470:in `plugin_hook'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `block (2
> levels) in run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:146:in
> `run_command'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:218:in `main'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:268:in
> `apply_catalog'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:192:in `run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:124:in `apply_catalog'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:160:in `benchmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:161:in `block in benchmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:125:in `block in
> apply_catalog'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:163:in `apply'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/report.rb:108:in
> `as_logging_destination'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/log.rb:149:in `with_destination'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:164:in `block in
> apply'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:108:in `evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/graph/relationship_graph.rb:118:in
> `traverse'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `block in
> evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:326:in `thinmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:327:in `block in thinmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `block (2
> levels) in evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `call'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:187:in `eval_resource'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:174:in `apply'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:20:in
> `evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:88:in
> `perform_changes'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:88:in
> `each'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:89:in
> `block in perform_changes'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:128:in
> `sync_if_needed'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:191:in
> `sync'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/type/exec.rb:142:in `sync'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/errors.rb:97:in `fail'
>   2015-05-11 19:24:39   ERR
>    ceph-deploy osd prepare node-5:/dev/sdb3: returned 1 instead of one of
> [0]
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy][ERROR ] GenericError:
> Failed to create 1 OSDs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][ERROR ] Failed to
> execute command: ceph-disk -v prepare --fs-type xfs --cluster ceph --
> /dev/sdb3 /dev/
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][ERROR ] RuntimeError:
> command returned non-zero exit status: 1
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING] ceph-disk: Error:
> Journal /dev/ is neither a block device nor regular file
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph
> --show-config-value=osd_journal_size
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_fs_mount_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_mount_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_fs_mkfs_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_mkfs_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph
> --show-config-value=fsid
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][INFO  ] Running command:
> ceph-disk -v prepare --fs-type xfs --cluster ceph -- /dev/sdb3 /dev/
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][DEBUG ] Preparing
> host node-5 disk /dev/sdb3 journal /dev/ activate False
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][INFO  ] Running command:
> udevadm trigger --subsystem-match=block --action=add
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] write cluster
> configuration to /etc/ceph/{cluster}.conf
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][DEBUG ] Deploying
> osd to node-5
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][INFO  ] Distro
> info: Ubuntu 14.04 trusty
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] detect machine type
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] detect platform
> information from remote host
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] connected to host:
> node-5
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][DEBUG ] Preparing
> cluster ceph disks node-5:/dev/sdb3:/dev/
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.cli][INFO  ] Invoked
> (1.5.20): /usr/bin/ceph-deploy osd prepare node-5:/dev/sdb3:
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.conf][DEBUG ] found
> configuration file at: /root/.cephdeploy.conf
>   2015-05-11 19:24:36   INFO
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]) Starting to evaluate the resource
>
>   Note :
>
>   Deployment is successful if no separate disk for journal is specified
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/fuel/+bug/1453959/+subscriptions
>