ironic_conductor - Permission denied: '/var/lib/ironic'

[Waldemar Znoinski]

Issue in ironic_conductor container reported by nova_compute_ironic when trying to deploy an ironic node set up by stable/mitaka kolla

Nova_compute_ironic log:

2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [req-3248377b-2d8f-4d41-b146-4844207594b9 66ff1de235364afaad77f3ae1395e90b eeb52de1247f4e91be78edd292f52bed - - -] [instance: 09c13b9c-699f-4838-a68f-369015d19012] Instance failed to spawn
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] Traceback (most recent call last):
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/compute/manager.py", line 2218, in _build_resources
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] yield resources
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/compute/manager.py", line 2064, in _build_and_run_instance
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] block_device_info=block_device_info)
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/ironic/driver.py", line 779, in spawn
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] 'node': node_uuid})
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] self.force_reraise()
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] six.reraise(self.type_, self.value, self.tb)
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/ironic/driver.py", line 771, in spawn
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] timer.start(interval=CONF.ironic.api_retry_interval).wait()
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/eventlet/event.py", line 121, in wait
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] return hubs.get_hub().switch()
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 294, in switch
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] return self.greenlet.switch()
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_service/loopingcall.py", line 136, in _run_loop
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] result = func(*self.args, **self.kw)
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/ironic/driver.py", line 407, in _wait_for_active
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] raise exception.InstanceDeployFailure(msg)
2016-08-10 13:39:14.365 1 ERROR nova.compute.manager [instance: 09c13b9c-699f-4838-a68f-369015d19012] InstanceDeployFailure: Failed to provision instance 09c13b9c-699f-4838-a68f-369015d19012: Failed to deploy. Error: [Errno 13] Permission denied: '/var/lib/ironic'

mkdir /var/lib/ironic
chown ironic:ironic /var/lib/ironic

Seems to fix the problem

[Waldemar Znoinski (wznoinsk)]

it's on stable/mitaka

[Waldemar Znoinski (wznoinsk)]

host OS: DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04.1 LTS"
NAME="Ubuntu"
VERSION="16.04.1 LTS (Xenial Xerus)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 16.04.1 LTS"
VERSION_ID="16.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
UBUNTU_CODENAME=xenial

container OS: DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=14.04
DISTRIB_CODENAME=trusty
DISTRIB_DESCRIPTION="Ubuntu 14.04.5 LTS"
NAME="Ubuntu"
VERSION="14.04.5 LTS, Trusty Tahr"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 14.04.5 LTS"
VERSION_ID="14.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"

[narasimha18sv (narasimha18sv)]

To resolve as a temporary workaround, create images and master_images folders in ironic-conductor container in ironic home directory and add the below configurations in ironic.conf

[pxe]
images_path = /home/ironic/images
instance_master_path = /home/ironic/master_images

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/372118

[OpenStack Infra (hudson-openstack)]

Change abandoned by Waldemar Znoinski (wznoinsk) (<email address hidden>) on branch: master
Review: https://review.openstack.org/372118
Reason: change included in https://review.openstack.org/#/c/379106/