From http://logs.openstack.org/70/113270/3/check/gate-nova-python26/038b3fa/console.html:
2014-08-21 20:08:33.507 | Traceback (most recent call last):
2014-08-21 20:08:33.507 | File "nova/tests/conductor/test_conductor.py", line 1343, in test_build_instances_scheduler_failure
2014-08-21 20:08:33.507 | legacy_bdm=False)
2014-08-21 20:08:33.507 | File "nova/conductor/rpcapi.py", line 415, in build_instances
2014-08-21 20:08:33.507 | cctxt.cast(context, 'build_instances', **kw)
2014-08-21 20:08:33.508 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/oslo/messaging/rpc/client.py", line 152, in call
2014-08-21 20:08:33.508 | retry=self.retry)
2014-08-21 20:08:33.508 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/oslo/messaging/transport.py", line 90, in _send
2014-08-21 20:08:33.508 | timeout=timeout, retry=retry)
2014-08-21 20:08:33.508 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/oslo/messaging/_drivers/impl_fake.py", line 194, in send
2014-08-21 20:08:33.508 | return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-08-21 20:08:33.508 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/oslo/messaging/_drivers/impl_fake.py", line 181, in _send
2014-08-21 20:08:33.508 | raise failure
2014-08-21 20:08:33.509 | UnexpectedMethodCallError: Unexpected method call. unexpected:- expected:+
2014-08-21 20:15:52.443 | - handle_schedule_error.__call__(<nova.tests.conductor.test_conductor.FakeContext object at 0xc19a3d0>, NoValidHost(u'No valid host was found. fake-reason',), '8eb9d649-0985-43libvir: error : internal error could not initialize domain event timer
2014-08-21 20:16:46.065 | Exception TypeError: "'NoneType' object is not callable" in <bound method GreenSocket.__del__ of <eventlet.greenio.GreenSocket object at 0xdc5bd10>> ignored
2014-08-21 20:19:45.254 | 50-8946-570ce100534c', {'instance_properties': Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone=None,cell_name=None,cleaned=False,config_drive=None,created_at=1955-11-05T00:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,disable_terminate=False,display_description=None,display_name=None,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,host='fake-host',hostname=None,id=1,image_ref=None,info_cache=<?>,instance_type_id=None,kernel_id=None,key_data=None,key_name=None,launch_index=None,launched_at=None,launched_on=None,locked=False,locked_by=None,memory_mb=None,metadata=<?>,node=None,os_type=None,pci_devices=<?>,power_state=None,progress=None,project_id='fake-project',ramdisk_id=None,reservation_id=None,root_device_name=None,root_gb=0,scheduled_at=None,security_groups=<?>,shutdown_terminate=False,system_metadata=<?>,task_state=None,terminated_at=None,updated_at=None,user_data=None,user_id='fake-user',uuid=8eb9d649-0985-4350-8946-570ce100534c,vcpus=None,vm_mode=None,vm_state=None), 'fake': 'specs'}) -> None
2014-08-21 20:19:45.254 | + handle_schedule_error.__call__(<nova.tests.conductor.test_conductor.FakeContext object at 0xc19a3d0>, NoValidHost(u'No valid host was found. fake-reason',), '712006a3-7ca5-4350-8f7f-028a9e4c78b2', {'instance_properties': Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone=None,cell_name=None,cleaned=False,config_drive=None,created_at=1955-11-05T00:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,disable_terminate=False,display_description=None,display_name=None,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,host='fake-host',hostname=None,id=1,image_ref=None,info_cache=<?>,instance_type_id=None,kernel_id=None,key_data=None,key_name=None,launch_index=None,launched_at=None,launched_on=None,locked=False,locked_by=None,memory_mb=None,metadata=<?>,node=None,os_type=None,pci_devices=<?>,power_state=None,progress=None,project_id='fake-project',ramdisk_id=None,reservation_id=None,root_device_name=None,root_gb=0,scheduled_at=None,security_groups=<?>,shutdown_terminate=False,system_metadata=<?>,task_state=None,terminated_at=None,updated_at=None,user_data=None,user_id='fake-user',uuid=8eb9d649-0985-4350-8946-570ce100534c,vcpus=None,vm_mode=None,vm_state=None), 'fake': 'specs'}) -> None
Yeah the diff is in the instance.uuid that's expected, from the test, it mocks out handle_ schedule_ error:
self.mox. StubOutWithMock (scheduler_ driver, 'handle_ schedule_ error')
It's trying to build 2 instances and handle errors for both:
for instance in instances:
scheduler_ driver. handle_ schedule_ error(self. context, exception,
instance. uuid, spec)
This is going through the now-deprecated _build_instances method in nova.compute. manager, which was updated recently to not call _instance_update:
https:/ /review. openstack. org/#/c/ 114033/
I'm not really sure how that would cause issues, unless it was slowing the test down before so we didn't race, or was changing the database differently?
Using this query:
message:"+ handle_ schedule_ error._ _call__ " AND message: "nova.tests. conductor. test_conductor. FakeContext object at" AND message:"No valid host was found. fake-reason" AND tags:"console" AND project: "openstack/ nova"
There are 14 hits since 8/21, check queue only and on 2 changes:
http:// logstash. openstack. org/#eyJzZWFyY2 giOiJtZXNzYWdlO lwiKyBoYW5kbGVf c2NoZWR1bGVfZXJ yb3IuX19jYWxsX1 9cIiBBTkQgbWVzc 2FnZTpcIm5vdmEu dGVzdHMuY29uZHV jdG9yLnRlc3RfY2 9uZHVjdG9yLkZha 2VDb250ZXh0IG9i amVjdCBhdFwiIEF ORCBtZXNzYWdlOl wiTm8gdmFsaWQga G9zdCB3YXMgZm91 bmQuIGZha2UtcmV hc29uXCIgQU5EIH RhZ3M6XCJjb25zb 2xlXCIgQU5EIHBy b2plY3Q6XCJvcGV uc3RhY2svbm92YV wiIiwiZmllbGRzI jpbXSwib2Zmc2V0 IjowLCJ0aW1lZnJ hbWUiOiI2MDQ4MD AiLCJncmFwaG1vZ GUiOiJjb3VudCIs InRpbWUiOnsidXN lcl9pbnRlcnZhbC I6MH0sInN0YW1wI joxNDA4NzIwMTI4 NDQyLCJtb2RlIjo iIiwiYW5hbHl6ZV 9maWVsZCI6IiJ9
One of those changes is an objects change, the other isn't, so this is probably something that is already merged.