Mykola,

Thanks for looking into this. I stiil can't generate a dump with 'fuel
snapshot' as I get this error :

File "/usr/lib64/python2.6/httplib.py", line 686, in _set_hostport raise
InvalidURL("nonnumeric port: '%s'" % host[i+1:])
httplib.InvalidURL: nonnumeric port: ''

So I'm attaching puppet.log and here's the requested info:

root@node-5:~# udevadm info -q property -n  /dev/sdg4
DEVLINKS=/dev/disk/by-id/scsi-3600508b1001c4b3e5cf1aba38f1213ae-part4
/dev/disk/by-id/wwn-0x600508b1001c4b3e5cf1aba38f1213ae-part4
/dev/disk/by-partlabel/primary
/dev/disk/by-parttypeuuid/45b0969e-9b03-4f30-b4c6-b4b80ceff106.37a4c27f-7dd7-4860-a229-fd1512597d02
/dev/disk/by-partuuid/37a4c27f-7dd7-4860-a229-fd1512597d02
/dev/disk/by-path/pci-0000:02:00.0-scsi-0:0:0:6-part4
DEVNAME=/dev/sdg4
DEVPATH=/devices/pci0000:00/0000:00:02.2/0000:02:00.0/host2/target2:0:0/2:0:0:6/block/sdg/sdg4
DEVTYPE=partition
ID_BUS=scsi
ID_MODEL=LOGICAL_VOLUME
ID_MODEL_ENC=LOGICAL\x20VOLUME\x20\x20
ID_PART_ENTRY_DISK=8:96
ID_PART_ENTRY_NAME=primary
ID_PART_ENTRY_NUMBER=4
ID_PART_ENTRY_OFFSET=21432320
ID_PART_ENTRY_SCHEME=gpt
ID_PART_ENTRY_SIZE=20971520
ID_PART_ENTRY_TYPE=45b0969e-9b03-4f30-b4c6-b4b80ceff106
ID_PART_ENTRY_UUID=37a4c27f-7dd7-4860-a229-fd1512597d02
ID_PART_TABLE_TYPE=gpt
ID_PATH=pci-0000:02:00.0-scsi-0:0:0:6
ID_PATH_TAG=pci-0000_02_00_0-scsi-0_0_0_6
ID_REVISION=5.42
ID_SCSI=1
ID_SCSI_SERIAL=00143802965FDC0
ID_SERIAL=3600508b1001c4b3e5cf1aba38f1213ae
ID_SERIAL_SHORT=600508b1001c4b3e5cf1aba38f1213ae
ID_TYPE=disk
ID_VENDOR=HP
ID_VENDOR_ENC=HP\x20\x20\x20\x20\x20\x20
ID_WWN=0x600508b1001c4b3e
ID_WWN_VENDOR_EXTENSION=0x5cf1aba38f1213ae
ID_WWN_WITH_EXTENSION=0x600508b1001c4b3e5cf1aba38f1213ae
MAJOR=8
MINOR=100
SUBSYSTEM=block
USEC_INITIALIZED=360241
nomdmonddf=1
nomdmonisw=1


Claude

2015-05-13 9:18 GMT-04:00 Mykola Golub <email address hidden>:

> Claude,
>
> You can try to generate snapshot from the command line on the master
> node:
>
>   fuel snapshot
>
> (note, it will take some time)
>
> If it still fails, please provide /var/log/puppet.log from the osd node.
>
> Also I am interested in seeing the output for this command:
>
> udevadm info -q property -n  /dev/sdg4
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1453959
>
> Title:
>   Can't deploy Ceph with disk dedicated for journal in Fuel 6.1
>
> Status in Fuel: OpenStack installer that works:
>   Invalid
>
> Bug description:
>   Environment:
>
>   {"build_id": "2015-05-08_05-40-59", "build_number": "223",
>   "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id":
>   "2015-05-08_05-40-59", "build_number": "223", "api": "1.0", "fuel-
>   library_sha": "53ce3081a4dfda2995232714de7d17e6edf6e97d",
>   "nailgun_sha": "ca9c91abed5e5b0671f4c514f7efd47eb5ca501c",
>   "feature_groups": ["experimental"], "openstack_version":
>   "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha":
>   "af6c9c3799b9ec107bcdc6dbf035cafc034526ce", "astute_sha":
>   "6a4dcd11c67af2917815f3678fb594c7412a4c97", "fuel-ostf_sha":
>   "740ded337bb2a8a9b3d505026652512257375c01", "release": "6.1",
>   "fuelmain_sha": "43b890efe560ab65dd748b8c2d7bd7d7cb0649e3"}}},
>   "auth_required": true, "api": "1.0", "fuel-library_sha":
>   "53ce3081a4dfda2995232714de7d17e6edf6e97d", "nailgun_sha":
>   "ca9c91abed5e5b0671f4c514f7efd47eb5ca501c", "feature_groups":
>   ["experimental"], "openstack_version": "2014.2.2-6.1", "production":
>   "docker", "python-fuelclient_sha":
>   "af6c9c3799b9ec107bcdc6dbf035cafc034526ce", "astute_sha":
>   "6a4dcd11c67af2917815f3678fb594c7412a4c97", "fuel-ostf_sha":
>   "740ded337bb2a8a9b3d505026652512257375c01", "release": "6.1",
>   "fuelmain_sha": "43b890efe560ab65dd748b8c2d7bd7d7cb0649e3"}
>
>   Steps to reproduce:
>
>   -Create environment with Juno on Ubuntu 14.04, KVM, Neutron with vlan
> seg., and Ceph for Cinder and Glance
>   -Deploy 3 controller nodes, 3 compute nodes and 3 Ceph nodes; each Ceph
> node has 5 hdd for data and 1 ssd for journal (Ceph repl. factor = 3)
>   -Deployment fails on all 3 Ceph nodes with the following error :
>
>   2015-05-11 19:24:39   ERR
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) change from notrun to 0 failed:
> ceph-deploy osd prepare node-5:/dev/sdb3: returned 1 instead of one of [0]
>   2015-05-11 19:24:39   ERR
>    /usr/bin/puppet:4:in `<main>'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:91:in `execute'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:137:in `run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:478:in `exit_on_fail'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `block in run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:470:in `plugin_hook'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `block (2
> levels) in run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:146:in
> `run_command'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:218:in `main'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:268:in
> `apply_catalog'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:192:in `run'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:124:in `apply_catalog'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:160:in `benchmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:161:in `block in benchmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:125:in `block in
> apply_catalog'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:163:in `apply'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/report.rb:108:in
> `as_logging_destination'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/log.rb:149:in `with_destination'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:164:in `block in
> apply'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:108:in `evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/graph/relationship_graph.rb:118:in
> `traverse'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `block in
> evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:326:in `thinmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util.rb:327:in `block in thinmark'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `block (2
> levels) in evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `call'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:187:in `eval_resource'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:174:in `apply'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:20:in
> `evaluate'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:88:in
> `perform_changes'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:88:in
> `each'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:89:in
> `block in perform_changes'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:128:in
> `sync_if_needed'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:191:in
> `sync'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/type/exec.rb:142:in `sync'
>   2015-05-11 19:24:39   ERR
>    /usr/lib/ruby/vendor_ruby/puppet/util/errors.rb:97:in `fail'
>   2015-05-11 19:24:39   ERR
>    ceph-deploy osd prepare node-5:/dev/sdb3: returned 1 instead of one of
> [0]
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy][ERROR ] GenericError:
> Failed to create 1 OSDs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][ERROR ] Failed to
> execute command: ceph-disk -v prepare --fs-type xfs --cluster ceph --
> /dev/sdb3 /dev/
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][ERROR ] RuntimeError:
> command returned non-zero exit status: 1
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING] ceph-disk: Error:
> Journal /dev/ is neither a block device nor regular file
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph
> --show-config-value=osd_journal_size
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_fs_mount_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_mount_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_fs_mkfs_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph
> --name=osd. --lookup osd_mkfs_options_xfs
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][WARNING]
> INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph
> --show-config-value=fsid
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][INFO  ] Running command:
> ceph-disk -v prepare --fs-type xfs --cluster ceph -- /dev/sdb3 /dev/
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][DEBUG ] Preparing
> host node-5 disk /dev/sdb3 journal /dev/ activate False
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][INFO  ] Running command:
> udevadm trigger --subsystem-match=block --action=add
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] write cluster
> configuration to /etc/ceph/{cluster}.conf
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][DEBUG ] Deploying
> osd to node-5
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][INFO  ] Distro
> info: Ubuntu 14.04 trusty
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] detect machine type
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] detect platform
> information from remote host
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [node-5][DEBUG ] connected to host:
> node-5
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.osd][DEBUG ] Preparing
> cluster ceph disks node-5:/dev/sdb3:/dev/
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.cli][INFO  ] Invoked
> (1.5.20): /usr/bin/ceph-deploy osd prepare node-5:/dev/sdb3:
>   2015-05-11 19:24:39   NOTICE
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]/returns) [ceph_deploy.conf][DEBUG ] found
> configuration file at: /root/.cephdeploy.conf
>   2015-05-11 19:24:36   INFO
>    (/Stage[main]/Ceph::Osds/Ceph::Osds::Osd[/dev/sdb3:]/Exec[ceph-deploy
> osd prepare node-5:/dev/sdb3:]) Starting to evaluate the resource
>
>   Note :
>
>   Deployment is successful if no separate disk for journal is specified
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/fuel/+bug/1453959/+subscriptions
>