Comment 2 for bug 1196666

Sure, here is our setup,

cinder & glance use the same ceph cluster backend but separate pool for glance and cinder as you can see from the config file below. CephX is enabled with the same key for both pools. For the openstack general setup,

(1) All services running on this controller node with two extra nova nodes total.
(2) All normal cinder/glance/nova functions regarding rbd work as expected, including live-migration, cinder boot volume creation from glance image linked-clone, snapshot of the cinder volume, nova booting from cinder volume and volume snapshot, cinder volume creation from another cinder volume snapshot, glance image creation to the backend rbd pool from a flat file, etc.

Here are the config files.

> cinder.conf
[DEFAULT]
rootwrap_config = /etc/cinder/rootwrap.conf
api_paste_confg = /etc/cinder/api-paste.ini
sql_connection = mysql://cinderUser:cinderPass@10.33.156.153/cinder
#iscsi_helper = tgtadm
iscsi_helper = ietadm
volume_name_template = volume-%s
volume_group = cinder-volumes
verbose = True
auth_strategy = keystone
#osapi_volume_listen_port=5900
state_path = /var/lib/cinder
lock_path = /var/lock/cinder
volumes_dir = /var/lib/cinder/volumes
volume_driver=cinder.volume.drivers.rbd.RBDDriver
rbd_pool=svl-ceph-openstack-volumes
rbd_user=svl-ceph-openstack-volumes
rbd_secret_uuid=e7724cad-23f6-d4ce-8c68-5f40491b15dd
glance_api_version=2

> glance.conf
.....
default_store = rbd
.....
rbd_store_ceph_conf = /etc/ceph/ceph.conf
rbd_store_user=svl-ceph-openstack-images
rbd_store_pool=svl-ceph-openstack-images
rbd_store_chunk_size = 8
show_image_direct_url=True

> dpkg output for the cinder/controller host,

oot@svl-ceph-10:/etc/glance# cat /etc/motd
Welcome to Ubuntu 12.04.2 LTS (GNU/Linux 3.5.0-27-generic x86_64)

ii ceph-common 0.61.4-1precise common utilities to mount and interact with a ceph storage cluster
ii cinder-api 1:2013.1-0ubuntu1~cloud0 Cinder storage service - API server
ii cinder-common 1:2013.1-0ubuntu1~cloud0 Cinder storage service - common files
ii cinder-scheduler 1:2013.1-0ubuntu1~cloud0 Cinder storage service - Scheduler server
ii cinder-volume 1:2013.1-0ubuntu1~cloud0 Cinder storage service - Volume server
ii glance 1:2013.1-0ubuntu1~cloud0 OpenStack Image Registry and Delivery Service - Daemons
ii glance-api 1:2013.1-0ubuntu1~cloud0 OpenStack Image Registry and Delivery Service - API
ii glance-common 1:2013.1-0ubuntu1~cloud0 OpenStack Image Registry and Delivery Service - Common
ii glance-registry 1:2013.1-0ubuntu1~cloud0 OpenStack Image Registry and Delivery Service - Registry
rc libcephfs1 0.56.4-1precise Ceph distributed file system client library
ii python-ceph 0.61.4-1precise Python libraries for the Ceph distributed filesystem
ii python-cinder 1:2013.1-0ubuntu1~cloud0 Cinder Python libraries
ii python-cinderclient 1:1.0.3-0ubuntu1~cloud0 python bindings to the OpenStack Volume API
ii python-glance 1:2013.1-0ubuntu1~cloud0 OpenStack Image Registry and Delivery Service - Python library
ii python-glanceclient 1:0.9.0-0ubuntu1~cloud0 Client library for Openstack glance server.

Regards,

Weiguo