kolla

deploy ubuntu source failed due to file permission issue

Bug #1667741 reported by Jeffrey Zhang on 2017-02-24

This bug report is a duplicate of: Bug #1668654: ubuntu libvirtError Unable to open logfile. Edit Remove

This bug affects 4 people

Affects		Status	Importance	Assigned to	Milestone
	kolla	New	Critical	Unassigned	kolla pike-2 "pike"
	Ocata	New	Critical	Unassigned	kolla ocata-rc2 "rc2"

Bug Description

Got following issue in gate, seem Ubuntu changed user's permission in package. guess this is related to libvirt or qemu packages.

2017-02-24 10:26:02.810 7 DEBUG oslo_messaging._drivers.amqpdriver [-] received reply msg_id: fb0f719e04b7476c9d4afc68e644b4e6 __call__ /var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:299
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [req-b0a59f30-df2a-48b6-a5f9-75736945f98f - - - - -] [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] Instance failed to spawn
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] Traceback (most recent call last):
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/compute/manager.py", line 2126, in _build_resources
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] yield resources
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1931, in _build_and_run_instance
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] block_device_info=block_device_info)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2655, in spawn
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] destroy_disks_on_failure=True)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 5066, in _create_domain_and_network
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] destroy_disks_on_failure)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] self.force_reraise()
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] six.reraise(self.type_, self.value, self.tb)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 5038, in _create_domain_and_network
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] post_xml_callback=post_xml_callback)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4956, in _create_domain
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] guest.launch(pause=pause)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 145, in launch
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] self._encoded_xml, errors='ignore')
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] self.force_reraise()
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] six.reraise(self.type_, self.value, self.tb)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 140, in launch
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] return self._domain.createWithFlags(flags)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] result = proxy_call(self._autowrap, f, *args, **kwargs)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] rv = execute(f, *args, **kwargs)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] six.reraise(c, e, tb)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/var/lib/kolla/venv/local/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] rv = meth(*args, **kwargs)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] File "/usr/lib/python2.7/site-packages/libvirt.py", line 1065, in createWithFlags
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7] libvirtError: internal error: process exited while connecting to monitor: 2017-02-24T10:26:02.560079Z qemu-system-x86_64: -chardev pty,id=charserial0,logfile=/var/lib/nova/instances/44a86a22-f8fc-4774-a16b-12a0c35b39b7/console.log,logappend=off: Unable to open logfile /var/lib/nova/instances/44a86a22-f8fc-4774-a16b-12a0c35b39b7/console.log: Permission denied
2017-02-24 10:26:02.816 7 ERROR nova.compute.manager [instance: 44a86a22-f8fc-4774-a16b-12a0c35b39b7]

more logs please check http://logs.openstack.org/00/432300/11/check/gate-kolla-dsvm-deploy-ubuntu-source-ubuntu-xenial-nv/8b5b7ec/logs/kolla/nova/nova-compute.txt.gz#_2017-02-24_10_26_02_816

See original description

Jeffrey Zhang (jeffrey4l) on 2017-02-24

description:

updated

Revision history for this message

Javier Castillo (javcasalc) wrote on 2017-03-06:

Do you also get these msgs when nova_libvirt starts?

2017-03-04 17:54:24.814+0000: 10037: info : libvirt version: 2.5.0, package: 3ubuntu2~cloud0 (Openstack Ubuntu Testing Bot <email address hidden> Tue, 31 Jan 2017 17:10:51 +0000)
2017-03-04 17:54:24.814+0000: 10037: info : hostname: compute01
2017-03-04 17:54:24.814+0000: 10037: error : dnsmasqCapsRefreshInternal:741 : Cannot check dnsmasq binary /usr/sbin/dnsmasq: No such file or directory
2017-03-04 17:54:25.159+0000: 10037: error : qemuMonitorJSONCheckError:387 : internal error: unable to execute QEMU command 'query-cpu-definitions': The command query-cpu-definitions has not been found
....
2017-03-04 17:54:26.120+0000: 10037: error : virSecurityDriverLookup:80 : unsupported configuration: Security driver apparmor not enabled

Jeffrey Zhang (jeffrey4l) on 2017-03-07

Changed in kolla:
importance:	Undecided → Critical
milestone:	none → pike-1

Revision history for this message

Khawar Munir Abbasi (ekhawmu) wrote on 2017-03-07:

@Javier
i got the same error which you mentioned. Any idea how to workaround?

Revision history for this message

Bertrand Lallau (bertrand-lallau) wrote on 2017-03-14:

Fix released for bug #1668654 doesn't fix it for me :(
I think reopen this bug

Revision history for this message

Jeffrey Zhang (jeffrey4l) wrote on 2017-03-18:

@Bertrand could u provide more info and post it in the bug #1668654

Report a bug

This report contains Public information

Everyone can see this information.

Duplicate of bug #1668654 Remove

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.