instance not found exceptions in the logs

[Dan Prince]

Using the latest Ceilometer Havana code I'm occasionally seeing the following types of ERRORs in my Nova compute logs:

2013-09-07 19:39:06.872 27183 WARNING ceilometer.compute.pollsters.disk [req-7b1c5b29-a6a0-4f9b-aa40-3ca85a705c7f 60298810906b472d8c9be8b57cc5fe32 b4c3f5a4eb5d4661b92491565725f398] Ignoring instance instance-00000001: Error from libvirt while looking up instance-00000001: [Error Code 42] Domain not found: no domain with matching name 'instance-00000001'
2013-09-07 19:39:06.872 27183 ERROR ceilometer.compute.pollsters.disk [req-7b1c5b29-a6a0-4f9b-aa40-3ca85a705c7f 60298810906b472d8c9be8b57cc5fe32 b4c3f5a4eb5d4661b92491565725f398] Error from libvirt while looking up instance-00000001: [Error Code 42] Domain not found: no domain with matching name 'instance-00000001'
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk Traceback (most recent call last):
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk File "/usr/lib/python2.6/site-packages/ceilometer/compute/pollsters/disk.py", line 86, in get_samples
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk instance_name,
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk File "/usr/lib/python2.6/site-packages/ceilometer/compute/pollsters/disk.py", line 58, in _populate_cache
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk for disk, info in inspector.inspect_disks(instance_name):
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk File "/usr/lib/python2.6/site-packages/ceilometer/compute/virt/libvirt/inspector.py", line 133, in inspect_disks
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk domain = self._lookup_by_name(instance_name)
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk File "/usr/lib/python2.6/site-packages/ceilometer/compute/virt/libvirt/inspector.py", line 90, in _lookup_by_name
2013-09-07 19:39:06.872 27183 TRACE ceilometer.compute.pollsters.disk raise virt_inspector.InstanceNotFoundException(msg)

----

When this happens I see similar errors for net and CPU pollsters as well. It would seem that having an instance disappear at just the right time might be the cause of this.

[ZhiQiang Fan (aji-zqfan)]

I checked the havana 2013.2 https://launchpad.net/ceilometer/havana/2013.2/+download/ceilometer-2013.2.tar.gz
which is very nearly to the bug report time
but not found such issue

the current code doesn't have this issue too, see https://github.com/openstack/ceilometer/blob/master/ceilometer/compute/pollsters/disk.py#L120

can you provide more information?