Activity log for bug #1314526

Date Who What changed Old value New value Message
2014-04-30 08:28:09 Oleksiy bug added bug
2014-04-30 08:28:09 Oleksiy attachment added error1.txt https://bugs.launchpad.net/bugs/1314526/+attachment/4101096/+files/error1.txt
2014-04-30 08:30:24 Oleksiy description We run multi-host nova-compute with libvirt_images_type=rbd libvirt_images_rbd_pool=compute Resize-confirm function works just fine. Resize-revert removes shared rbd for both instances image during reverting. Options nova.conf i've tried to change with no luck : allow_resize_to_same_host=True/False resize_fs_using_block_device=True/False block_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER, VIR_MIGRATE_NON_SHARED_INC live_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER Errors you can find at the bottom of the page: During revert process for both types of migration there is driver.destroy() at destination that removes original image from rbd storage. https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3164 _____________ def revert_resize(self, context, instance, migration, reservations): ... self.driver.destroy(context, instance, network_info, block_device_info) ... _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L956 _____________ def destroy(self, context, instance, network_info, block_device_info=None, destroy_disks=True): self._destroy(instance) self.cleanup(context, instance, network_info, block_device_info, destroy_disks) _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L1069 _____________ def cleanup(self, context, instance, network_info, block_device_info=None, destroy_disks=True): .... if destroy_disks: self._delete_instance_files(instance) self._cleanup_lvm(instance) #NOTE(haomai): destroy volumes if needed if CONF.libvirt.images_type == 'rbd': self._cleanup_rbd(instance) .... _____________ revert_resize runs destroy function without destory_disk variable which makes cleanup function to delete SHARED image. Here is approximate solution (not a developer) https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3199 change from : _____________ self.driver.destroy(context, instance, network_info, block_device_info) _____________ to: _____________ destroy_disks = not (self._is_instance_storage_shared(context, instance)) self.driver.destroy(instance, network_info, block_device_info) block_device_info, destroy_disks=destroy_disks) _____________ ERROR1#################################################### <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.imagebackend ERROR: error opening rbd image /var/lib/ nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__ read_only=read_only) File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__ raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ImageNotFound: error opening image /var/lib/nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 at snapshot None <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3160, in finish_resize disk_info, image) File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3128, in _finish_resize block_device_info, power_on) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4627, in finish_migration block_device_info=None, inject_files=False) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2395, in _create_image project_id=instance['project_id']) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 177, in cache *args, **kwargs) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 638, in create_image self.verify_base_size(base, size) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 218, in verify_base_size base_size = self.get_disk_size(base) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 622, in get_disk_size with RBDVolumeProxy(self, name) as vol: File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__ read_only=read_only) File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__ raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ERROR2#################################################### <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.driver ERROR: An error occurred while trying to launc h a defined domain with xml ... <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4997, in _error_out_instance_on_exception yield File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2841, in finish_revert_resize block_device_info, power_on) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4673, in finish_revert_migration block_device_info, power_on) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3255, in _create_domain_and_network domain = self._create_domain(xml, instance=instance, power_on=power_on) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3198, in _create_domain domain.XMLDesc(0)) File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3193, in _create_domain domain.createWithFlags(launch_flags) File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit result = proxy_call(self._autowrap, f, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call rv = execute(f,*args,**kwargs) File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker rv = meth(*args,**kwargs) File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in createWithFlags if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirtError: internal error process exited while connecting to monitor: char device redirected to /dev/pts/4 kvm: -drive file=rbd:compute/02496df7-9514-43c7-a687-835488e43c0c_disk:id=compute:key=AQDl3ipTwGYSHBAAyjaA2kYw7zQb6TaRdvKflQ==:auth_supported=cephx\;none:mon_host=10.100.0.6\:6789\;10.100.0.9\:6789\;10.100.0.10\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=none: error reading header from 02496df7-9514-43c7-a687-835488e43c0c_disk kvm: -drive file=rbd:compute/02496df7-9514-43c7-a687-835488e43c0c_disk:id=compute:key=AQDl3ipTwGYSHBAAyjaA2kYw7zQb6TaRdvKflQ==:auth_supported=cephx\;none:mon_host=10.100.0.6\:6789\;10.100.0.9\:6789\;10.100.0.10\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=none: could not open disk image rbd:compute/02496df7-9514-43c7-a687-835488e43c0c_disk:id=compute:key=AQDl3ipTwGYSHBAAyjaA2kYw7zQb6TaRdvKflQ==:auth_supported=cephx\;none:mon_host=10.100.0.6\:6789\;10.100.0.9\:6789\;10.100.0.10\:6789: No such file or directory #################################################### We run multi-host nova-compute with libvirt_images_type=rbd libvirt_images_rbd_pool=compute Resize-confirm function works just fine. Resize-revert removes shared rbd for both instances image during reverting. Options nova.conf i've tried to change with no luck : allow_resize_to_same_host=True/False resize_fs_using_block_device=True/False block_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER, VIR_MIGRATE_NON_SHARED_INC live_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER Errors you can find at the bottom of the page: During revert process for both types of migration there is driver.destroy() at destination that removes original image from rbd storage. https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3164 _____________ def revert_resize(self, context, instance, migration, reservations):            ...            self.driver.destroy(context, instance, network_info,                                block_device_info)            ... _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L956 _____________ def destroy(self, context, instance, network_info, block_device_info=None,              destroy_disks=True):      self._destroy(instance)      self.cleanup(context, instance, network_info, block_device_info,                   destroy_disks) _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L1069 _____________ def cleanup(self, context, instance, network_info, block_device_info=None,                 destroy_disks=True):     ....         if destroy_disks:             self._delete_instance_files(instance)             self._cleanup_lvm(instance)             #NOTE(haomai): destroy volumes if needed             if CONF.libvirt.images_type == 'rbd':                 self._cleanup_rbd(instance)     .... _____________ revert_resize runs destroy function without destory_disk variable which makes cleanup function to delete SHARED image. Here is approximate solution (not a developer) https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3199 change from : _____________ self.driver.destroy(context, instance, network_info,                                 block_device_info) _____________ to: _____________ destroy_disks = not (self._is_instance_storage_shared(context, instance))              self.driver.destroy(instance, network_info,                                 block_device_info)                                 block_device_info, destroy_disks=destroy_disks) _____________ ERROR1#################################################### <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.imagebackend ERROR: error opening rbd image /var/lib/ nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__     read_only=read_only)   File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__     raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ImageNotFound: error opening image /var/lib/nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 at snapshot None <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3160, in finish_resize     disk_info, image)   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3128, in _finish_resize     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4627, in finish_migration     block_device_info=None, inject_files=False)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2395, in _create_image     project_id=instance['project_id'])   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 177, in cache     *args, **kwargs)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 638, in create_image     self.verify_base_size(base, size)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 218, in verify_base_size     base_size = self.get_disk_size(base)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 622, in get_disk_size     with RBDVolumeProxy(self, name) as vol:   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__     read_only=read_only)   File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__     raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ERROR2#################################################### <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.driver ERROR: An error occurred while trying to launc h a defined domain with xml ... <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4997, in _error_out_instance_on_exception     yield   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2841, in finish_revert_resize     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4673, in finish_revert_migration     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3255, in _create_domain_and_network     domain = self._create_domain(xml, instance=instance, power_on=power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3198, in _create_domain     domain.XMLDesc(0))   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3193, in _create_domain     domain.createWithFlags(launch_flags)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit     result = proxy_call(self._autowrap, f, *args, **kwargs)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call     rv = execute(f,*args,**kwargs)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker     rv = meth(*args,**kwargs)   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in createWithFlags     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirtError: internal error process exited while connecting to monitor: char device redirected to /dev/pts/4 kvm: -drive file=rbd:.... hiden... No such file or directory ####################################################
2014-04-30 08:31:19 Oleksiy attachment removed error1.txt https://bugs.launchpad.net/nova/+bug/1314526/+attachment/4101096/+files/error1.txt
2014-04-30 12:22:09 Oleksiy description We run multi-host nova-compute with libvirt_images_type=rbd libvirt_images_rbd_pool=compute Resize-confirm function works just fine. Resize-revert removes shared rbd for both instances image during reverting. Options nova.conf i've tried to change with no luck : allow_resize_to_same_host=True/False resize_fs_using_block_device=True/False block_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER, VIR_MIGRATE_NON_SHARED_INC live_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER Errors you can find at the bottom of the page: During revert process for both types of migration there is driver.destroy() at destination that removes original image from rbd storage. https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3164 _____________ def revert_resize(self, context, instance, migration, reservations):            ...            self.driver.destroy(context, instance, network_info,                                block_device_info)            ... _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L956 _____________ def destroy(self, context, instance, network_info, block_device_info=None,              destroy_disks=True):      self._destroy(instance)      self.cleanup(context, instance, network_info, block_device_info,                   destroy_disks) _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L1069 _____________ def cleanup(self, context, instance, network_info, block_device_info=None,                 destroy_disks=True):     ....         if destroy_disks:             self._delete_instance_files(instance)             self._cleanup_lvm(instance)             #NOTE(haomai): destroy volumes if needed             if CONF.libvirt.images_type == 'rbd':                 self._cleanup_rbd(instance)     .... _____________ revert_resize runs destroy function without destory_disk variable which makes cleanup function to delete SHARED image. Here is approximate solution (not a developer) https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3199 change from : _____________ self.driver.destroy(context, instance, network_info,                                 block_device_info) _____________ to: _____________ destroy_disks = not (self._is_instance_storage_shared(context, instance))              self.driver.destroy(instance, network_info,                                 block_device_info)                                 block_device_info, destroy_disks=destroy_disks) _____________ ERROR1#################################################### <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.imagebackend ERROR: error opening rbd image /var/lib/ nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__     read_only=read_only)   File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__     raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ImageNotFound: error opening image /var/lib/nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 at snapshot None <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3160, in finish_resize     disk_info, image)   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3128, in _finish_resize     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4627, in finish_migration     block_device_info=None, inject_files=False)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2395, in _create_image     project_id=instance['project_id'])   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 177, in cache     *args, **kwargs)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 638, in create_image     self.verify_base_size(base, size)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 218, in verify_base_size     base_size = self.get_disk_size(base)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 622, in get_disk_size     with RBDVolumeProxy(self, name) as vol:   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__     read_only=read_only)   File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__     raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ERROR2#################################################### <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.driver ERROR: An error occurred while trying to launc h a defined domain with xml ... <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4997, in _error_out_instance_on_exception     yield   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2841, in finish_revert_resize     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4673, in finish_revert_migration     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3255, in _create_domain_and_network     domain = self._create_domain(xml, instance=instance, power_on=power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3198, in _create_domain     domain.XMLDesc(0))   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3193, in _create_domain     domain.createWithFlags(launch_flags)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit     result = proxy_call(self._autowrap, f, *args, **kwargs)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call     rv = execute(f,*args,**kwargs)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker     rv = meth(*args,**kwargs)   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in createWithFlags     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirtError: internal error process exited while connecting to monitor: char device redirected to /dev/pts/4 kvm: -drive file=rbd:.... hiden... No such file or directory #################################################### We run multi-host nova-compute with libvirt_images_type=rbd libvirt_images_rbd_pool=compute Resize-confirm function works just fine. Resize-revert removes shared rbd for both instances image during reverting. Options nova.conf i've tried to change with no luck : allow_resize_to_same_host=True/False resize_fs_using_block_device=True/False block_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER, VIR_MIGRATE_NON_SHARED_INC live_migration_flag=VIR_MIGRATE_UNDEFINE_SOURCE, VIR_MIGRATE_PEER2PEER Errors you can find at the bottom of the page. 1. first error was fixed by adding image_cache_manager_interval = 0 2. 2nd error still active. During revert process for both types of migration there is driver.destroy() at destination that removes original image from rbd storage. https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3164 _____________ def revert_resize(self, context, instance, migration, reservations):            ...            self.driver.destroy(context, instance, network_info,                                block_device_info)            ... _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L956 _____________ def destroy(self, context, instance, network_info, block_device_info=None,              destroy_disks=True):      self._destroy(instance)      self.cleanup(context, instance, network_info, block_device_info,                   destroy_disks) _____________ that calls https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L1069 _____________ def cleanup(self, context, instance, network_info, block_device_info=None,                 destroy_disks=True):     ....         if destroy_disks:             self._delete_instance_files(instance)             self._cleanup_lvm(instance)             #NOTE(haomai): destroy volumes if needed             if CONF.libvirt.images_type == 'rbd':                 self._cleanup_rbd(instance)     .... _____________ revert_resize runs destroy function without destory_disk variable which makes cleanup function to delete SHARED image. Here is approximate solution (not a developer) https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3199 change from : _____________ self.driver.destroy(context, instance, network_info,                                 block_device_info) _____________ to: _____________ destroy_disks = not (self._is_instance_storage_shared(context, instance))              self.driver.destroy(instance, network_info,                                 block_device_info)                                 block_device_info, destroy_disks=destroy_disks) _____________ ERROR1#################################################### <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.imagebackend ERROR: error opening rbd image /var/lib/ nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__     read_only=read_only)   File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__     raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ImageNotFound: error opening image /var/lib/nova/instances/_base/103bc0322b21e499ecea1c360abc6843ab829d06 at snapshot None <179>Apr 28 14:14:00 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3160, in finish_resize     disk_info, image)   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3128, in _finish_resize     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4627, in finish_migration     block_device_info=None, inject_files=False)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2395, in _create_image     project_id=instance['project_id'])   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 177, in cache     *args, **kwargs)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 638, in create_image     self.verify_base_size(base, size)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 218, in verify_base_size     base_size = self.get_disk_size(base)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 622, in get_disk_size     with RBDVolumeProxy(self, name) as vol:   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/imagebackend.py", line 467, in __init__     read_only=read_only)   File "/usr/lib/python2.7/dist-packages/rbd.py", line 351, in __init__     raise make_ex(ret, 'error opening image %s at snapshot %s' % (name, snapshot)) ERROR2#################################################### <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.virt.libvirt.driver ERROR: An error occurred while trying to launc h a defined domain with xml ... <179>Apr 29 08:34:13 [compute] node-39 <U+FEFF>nova-nova.compute.manager ERROR: Setting instance vm_state to ERROR Traceback (most recent call last):   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4997, in _error_out_instance_on_exception     yield   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2841, in finish_revert_resize     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4673, in finish_revert_migration     block_device_info, power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3255, in _create_domain_and_network     domain = self._create_domain(xml, instance=instance, power_on=power_on)   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3198, in _create_domain     domain.XMLDesc(0))   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3193, in _create_domain     domain.createWithFlags(launch_flags)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit     result = proxy_call(self._autowrap, f, *args, **kwargs)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call     rv = execute(f,*args,**kwargs)   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker     rv = meth(*args,**kwargs)   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 711, in createWithFlags     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirtError: internal error process exited while connecting to monitor: char device redirected to /dev/pts/4 kvm: -drive file=rbd:.... hiden... No such file or directory ####################################################
2014-04-30 16:47:21 Tracy Jones tags libvirt
2014-05-01 19:11:41 Solly Ross nova: status New Triaged
2014-05-01 19:11:46 Solly Ross nova: importance Undecided High
2014-05-03 06:47:24 Dmitry Borodaenko nova: assignee Dmitry Borodaenko (dborodaenko)
2014-05-14 08:46:07 Semyon Deviatkin bug added subscriber Semeyon Deviatkin
2014-07-09 22:09:13 Josh Durgin bug added subscriber Josh Durgin
2014-07-10 19:52:17 Dmitry Borodaenko nova: status Triaged In Progress
2014-07-16 02:18:11 OpenStack Infra nova: status In Progress Fix Committed
2014-07-23 14:53:42 Russell Bryant nova: status Fix Committed Fix Released
2014-07-23 14:53:42 Russell Bryant nova: milestone juno-2
2014-08-08 20:17:07 Solly Ross nova: status Fix Released Confirmed
2014-09-10 06:50:12 Dr. Jens Harbott bug added subscriber Dr. Jens Rosenboom
2014-10-01 13:50:26 Thierry Carrez nova: milestone juno-2
2014-12-17 14:08:42 Nobuto Murata bug added subscriber Nobuto MURATA
2014-12-19 10:53:27 Matt Jarvis bug added subscriber Matt Jarvis
2015-01-07 18:19:38 Dmitry Borodaenko nova: assignee Dmitry Borodaenko (dborodaenko) Solly Ross (sross-7)
2015-01-07 18:19:44 Dmitry Borodaenko nova: status Confirmed Incomplete
2015-01-07 18:30:29 Dmitry Borodaenko nova: assignee Solly Ross (sross-7) Jon Bernard (jbernard)
2015-01-07 18:30:44 Dmitry Borodaenko nova: status Incomplete In Progress
2015-02-12 15:03:26 Davanum Srinivas (DIMS) nova: status In Progress Confirmed
2015-02-12 15:03:30 Davanum Srinivas (DIMS) nova: assignee Jon Bernard (jbernard)
2015-04-28 15:01:26 Daniel Speichert bug added subscriber Daniel Speichert
2015-09-14 18:17:50 OpenStack Infra nova: status Confirmed In Progress
2015-09-14 18:17:50 OpenStack Infra nova: assignee Dan Smith (danms)
2015-09-14 19:15:44 Jon Bernard marked as duplicate 1399244
2015-09-15 01:05:55 OpenStack Infra nova: assignee Dan Smith (danms) Nicolas Simonds (nicolas.simonds)
2016-01-15 19:25:22 Matt Riedemann tags libvirt ceph libvirt
2016-01-26 06:11:36 OpenStack Infra nova: status In Progress Fix Released
2016-02-26 16:36:09 OpenStack Infra tags ceph libvirt ceph in-stable-liberty libvirt
2016-08-08 07:35:35 Nick bug added subscriber Nick