Glance Error: image-cache/image-cache permission denied

[Vitaly Kramskikh]

build_id": "2014-02-24_01-17-30",
 "mirantis": "yes",
"build_number": "181",
"nailgun_sha": "f786786894acc331a4b53b31f33e373ef95ccdfc",
"ostf_sha": "b8f16a0288cbf39e11e0b4a41a3f63e6b87dcc4b",
"fuelmain_sha": "9a8f918f0f5113970888c43147cc0c3cd46c956e",
"astute_sha": "3d43abeefb60677ce6cae83d31ebbba1ff3cdbe2",
"release": "4.1",
"fuellib_sha": "e3ea44c3b607f37401a268a91956c9d222a81bab"

1. Create new environment (Ubuntu, HA mode)
2. Choose Neutron VLAN segmentation
3. Add 3 controllers, 1 compute and 1 cinder
4. Start deployment. It will be successful.
5. Run OSTF tests. Some test will fail including "Check that required services are running" and "Launch instance"
6. Go to controller node and run "nova-manage service list". You'll see some services on one of controllers are not started:
root@node-3:/var/log# nova-manage service list
Binary Host Zone Status State Updated_At
nova-consoleauth node-3 internal enabled XXX 2014-02-24 17:45:32
nova-cert node-3 internal enabled XXX 2014-02-24 17:45:31
nova-scheduler node-3 internal enabled XXX 2014-02-24 17:45:23
nova-conductor node-3 internal enabled XXX 2014-02-24 17:45:32

You'll also see an error in glance-all.log on that node:

<147>Feb 24 15:37:53 node-3 <U+FEFF>glance-glance.store.filesystem ERROR: Could not find filesystem_store_datadir in configuration options.
...
<147>Feb 24 16:46:16 node-3 <U+FEFF>glance-glance.image_cache ERROR: Exception encountered while tee'ing image 'dc1275ab-6bcb-4af1-9c84-d0271f13e99c' into cache: [Errno 13] Permission denied: '/var/lib/glance/image-cache/incomplete/dc1275ab-6bcb-4af1-9c84-d0271f13e99c'. Continuing with response.
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/glance/image_cache/__init__.py", line 237, in cache_tee_iter
    with self.driver.open_for_write(image_id) as cache_file:
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/usr/lib/python2.7/dist-packages/glance/image_cache/drivers/sqlite.py", line 334, in open_for_write
    with open(incomplete_path, 'wb') as cache_file:
IOError: [Errno 13] Permission denied: '/var/lib/glance/image-cache/incomplete/dc1275ab-6bcb-4af1-9c84-d0271f13e99c'

[Matthew Mosesohn (raytrac3r)]

I can reproduce, but all nodes are functional. TestVM added with no problem.

/var/lib/glance/image-cache is owned by glance:glance, but its subdirectories are owned by root/root
I can't reproduce the issue, but it looks like it should be fixed in the Ubuntu package. I submitted a request to OSCI.

I'll submit a fix for the glance API settings to add the filesystem_store_data setting to Glance API (it's necessary in both API conf and cache conf).

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/76252

[Matthew Mosesohn (raytrac3r)]

glance 2013.2.2.fuel4.1~mira2 package works

[Andrey Sledzinskiy (asledzinskiy)]

Verified on ISO #214

Revision: 6e6f6b31b8880b7600a1af5cc94d48ac01d60a07
origin/master