check-grenade-dsvm-partial-ncpu breaks on libguestfs
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Opinion
|
Undecided
|
Unassigned | ||
devstack |
Invalid
|
Undecided
|
Unassigned |
Bug Description
http://
2014-03-03 18:35:59.215 6130 TRACE nova.servicegro
2014-03-03 18:35:59.215 6130 TRACE nova.servicegro
2014-03-03 18:35:59.215 6130 TRACE nova.servicegro
2014-03-03 18:35:59.216 6130 WARNING nova.openstack.
2014-03-03 18:36:38.563 6130 ERROR nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
2014-03-03 18:36:38.563 6130 TRACE nova.openstack.
Changed in nova: | |
milestone: | none → icehouse-rc1 |
Changed in nova: | |
milestone: | icehouse-rc1 → icehouse-3 |
Changed in nova: | |
milestone: | icehouse-3 → icehouse-rc1 |
summary: |
- check-grenade-dsvm-partial-ncpu breaks waiting while waiting for - conductor + check-grenade-dsvm-partial-ncpu breaks on libguestfs |
tags: | added: testing |
Changed in nova: | |
milestone: | icehouse-rc1 → next |
tags: | added: icehouse-rc-potential |
tags: |
added: icehouse-backport-potential removed: icehouse-rc-potential |
It turns out the waiting for waiting for conductor is when the conductor is being upgraded.
The real bug was file injection was enabled by default in havana. It would silently error out when libguestfs isn't installed (as its not in in havana). but when we upgrade libguestfs get installed and nova dynamically loads it.
2014-03-03 18:41:39.708 ERROR nova.virt. libvirt. driver [req-fc92fbbf- acd4-40a5- 8d74-a8bdd263c2 97 ServersTestManu alDisk- 834103425 ServersTestManu alDisk- 1514739295] [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] Error injecting data into image cf82ca56- 7fda-4e29- ae75-96be49f2a0 59 (Error mounting /opt/stack/ data/nova/ instances/ a9a923e6- 5748-465e- 8ad3-84077b1544 7e/disk with libguestfs (external command failed, see earlier error messages)) manager [req-fc92fbbf- acd4-40a5- 8d74-a8bdd263c2 97 ServersTestManu alDisk- 834103425 ServersTestManu alDisk- 1514739295] [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] Instance failed to spawn manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] Traceback (most recent call last): manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/compute/ manager. py", line 1423, in _spawn manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] block_device_info) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ libvirt/ driver. py", line 2084, in spawn manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] admin_pass= admin_password) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ libvirt/ driver. py", line 2514, in _create_image manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] instance=instance) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ libvirt/ driver. py", line 2508, in _create_image manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] mandatory= ('files' ,)) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ disk/api. py", line 329, in inject_data manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] fs.setup() manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ disk/vfs/ guestfs. py", line 129, in setup manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] {'imgfile': self.imgfile, 'e': e}) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] NovaException: Error mounting /opt/stack/ data/nova/ instan. ..
2014-03-03 18:41:39.709 ERROR nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.