[R4.0 build 7]Adding glance images is getting failed

[aswani kumar]

R4.0 build 7 mitaka multinode

seeing this in glance-api log

/var/log/glance/api.log:

2017-05-19 12:20:15.829 21309 ERROR glance_store._drivers.rbd Traceback (most recent call last):
2017-05-19 12:20:15.829 21309 ERROR glance_store._drivers.rbd File "/usr/lib/python2.7/dist-packages/glance_store/_drivers/rbd.py", line 201, in get_connection
2017-05-19 12:20:15.829 21309 ERROR glance_store._drivers.rbd client.connect(timeout=self.connect_timeout)
2017-05-19 12:20:15.829 21309 ERROR glance_store._drivers.rbd File "rados.pyx", line 785, in rados.Rados.connect (/build/ceph-de0qCr/ceph-10.2.2/src/build/rados.c:9327)
2017-05-19 12:20:15.829 21309 ERROR glance_store._drivers.rbd ObjectNotFound: error connecting to the cluster
2017-05-19 12:20:15.829 21309 ERROR glance_store._drivers.rbd
2017-05-19 12:20:15.830 21309 DEBUG oslo_messaging._drivers.amqpdriver [req-577bb2ad-eb21-4edc-90c1-69ea279fd020 e088f034aa674a648316e2bc68f91192 8b822085b14b402c92e7118c5c70394d - - -] CAST unique_id: 6cd74d000cec4761bc77ff129faa2bb4 NOTIFY exchange 'glance' topic 'notifications.error' _send /usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:438
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data [req-577bb2ad-eb21-4edc-90c1-69ea279fd020 e088f034aa674a648316e2bc68f91192 8b822085b14b402c92e7118c5c70394d - - -] Failed to upload image data due to internal error
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data Traceback (most recent call last):
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance/api/v2/image_data.py", line 114, in upload
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data image.set_data(data, size)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance/domain/proxy.py", line 195, in set_data
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data self.base.set_data(data, size)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance/notifier.py", line 449, in set_data
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data _send_notification(notify_error, 'image.upload', msg)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in exit
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data self.force_reraise()
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data six.reraise(self.type_, self.value, self.tb)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance/notifier.py", line 396, in set_data
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data self.repo.set_data(data, size)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance/api/policy.py", line 192, in set_data
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data return self.image.set_data(*args, **kwargs)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance/quota/__init__.py", line 298, in set_data
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data self.image.set_data(data, size=size)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance/location.py", line 426, in set_data
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data verifier=verifier)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance_store/backend.py", line 371, in add_to_backend
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data verifier)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance_store/backend.py", line 344, in store_add_to_backend
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data verifier=verifier)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance_store/capabilities.py", line 226, in op_checker
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data return store_op_fun(store, args, *kwargs)
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance_store/_drivers/rbd.py", line 375, in add
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data rados_id=self.user) as conn:
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/contextlib.py", line 17, in enter
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data return self.gen.next()
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data File "/usr/lib/python2.7/dist-packages/glance_store/_drivers/rbd.py", line 205, in get_connection
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data raise exceptions.BackendException()
2017-05-19 12:20:15.833 21309 ERROR glance.api.v2.image_data BackendException

[Sudheendra Rao (sudheendra-k)]

Change the following entry in glance-api.conf and restart glance-api service:

Comment out all entries in glance-api.conf which has rbd references(mentioned below) and set default_store=file

stores = glance.store.rbd.Store,glance.store.filesystem.Store,glance.store.http.Store
default_store = rbd
rbd_store_chunk_size = 8
rbd_store_pool = images
rbd_store_user = images
rbd_store_ceph_conf = /etc/ceph/ceph.conf

[Abhay Joshi (abhayj)]

Is this something that worked in build 6 and not working in build 7?

[Jeba Paulaiyan (jebap)]

Yes

[Dheeraj Gautam (dgautam)]

https://review.opencontrail.org/31746 has already fixed this.