euca-run-instances causes scheduler to throw an error and instance to fail to launch

Bug #1023614 reported by Joe Breu
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
New
Undecided
Unassigned

Bug Description

Running the command:

euca-run-instances -t m1.tiny -z nova ami-00000003

Causes the following stack trace in nova-scheduler

2012-07-11 21:16:14 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin', u'KeystoneAdmin', u'KeystoneServiceAdmin'], u'_context_request_id': u'req-48c1e82f-19dc-490e-8de9-13e810f3ae5b', u'_context_read_deleted': u'no', u'args': {u'request_spec': {u'num_instances': 1, u'block_device_mapping': [], u'image': {u'status': u'active', u'name': u'tty-image', u'deleted': False, u'container_format': u'ami', u'created_at': u'2012-07-11 19:56:35', u'disk_format': u'ami', u'updated_at': u'2012-07-11 19:56:37', u'properties': {u'kernel_id': u'0a028ec1-1958-4a85-a845-5cfc00be185f', u'ramdisk_id': u'400a3919-b2a6-4996-9f81-9b1ab284f299'}, u'min_ram': u'0', u'checksum': u'10047a119149e08fb206eea89832eee0', u'min_disk': u'0', u'is_public': True, u'deleted_at': None, u'id': u'0bbc53c5-a6fd-483b-a39e-69427c72391d', u'size': 25165824}, u'instance_type': {u'root_gb': 0, u'name': u'm1.tiny', u'flavorid': u'1', u'deleted': False, u'created_at': None, u'ephemeral_gb': 0, u'updated_at': None, u'memory_mb': 512, u'vcpus': 1, u'extra_specs': {}, u'swap': 0, u'rxtx_factor': 1.0, u'deleted_at': None, u'vcpu_weight': None, u'id': 2}, u'instance_properties': {u'vm_state': u'building', u'availability_zone': u'nova', u'launch_time': u'2012-07-11T21:16:13Z', u'ephemeral_gb': 0, u'instance_type_id': 2, u'user_data': u'', u'vm_mode': None, u'reservation_id': u'r-v030wsje', u'root_device_name': None, u'display_name': None, u'uuid': u'12c6e457-a5da-48e7-a2d2-32db1dc98071', u'display_description': u'', u'key_data': None, u'power_state': 0, u'progress': 0, u'project_id': u'54f0aa340744400f8aaec93b9c300ebe', u'metadata': {}, u'ramdisk_id': u'400a3919-b2a6-4996-9f81-9b1ab284f299', u'access_ip_v6': None, u'access_ip_v4': None, u'kernel_id': u'0a028ec1-1958-4a85-a845-5cfc00be185f', u'key_name': None, u'user_id': u'ec61940e9aae4356b3a12cf0530a6f24', u'config_drive_id': u'', u'root_gb': 0, u'locked': False, u'launch_index': 0, u'memory_mb': 512, u'vcpus': 1, u'image_ref': u'0bbc53c5-a6fd-483b-a39e-69427c72391d', u'architecture': None, u'auto_disk_config': None, u'os_type': None, u'config_drive': u''}, u'security_group': u'default'}, u'is_first_time': True, u'filter_properties': {u'scheduler_hints': None}, u'topic': u'compute', u'admin_password': '<SANITIZED>', u'injected_files': None, u'requested_networks': None}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': u'54f0aa340744400f8aaec93b9c300ebe', u'_context_timestamp': u'2012-07-11T21:16:12.513214', u'_context_user_id': u'ec61940e9aae4356b3a12cf0530a6f24', u'method': u'run_instance', u'_context_remote_address': u'192.168.1.224'} from (pid=13681) _safe_log /usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-07-11 21:16:14 DEBUG nova.rpc.amqp [req-48c1e82f-19dc-490e-8de9-13e810f3ae5b ec61940e9aae4356b3a12cf0530a6f24 54f0aa340744400f8aaec93b9c300ebe] unpacked context: {'user_id': u'ec61940e9aae4356b3a12cf0530a6f24', 'roles': [u'admin', u'KeystoneAdmin', u'KeystoneServiceAdmin'], 'timestamp': '2012-07-11T21:16:12.513214', 'auth_token': '<SANITIZED>', 'remote_address': u'192.168.1.224', 'is_admin': True, 'request_id': u'req-48c1e82f-19dc-490e-8de9-13e810f3ae5b', 'project_id': u'54f0aa340744400f8aaec93b9c300ebe', 'read_deleted': u'no'} from (pid=13681) _safe_log /usr/lib/python2.7/dist-packages/nova/rpc/common.py:160
2012-07-11 21:16:14 DEBUG nova.scheduler.filter_scheduler [req-48c1e82f-19dc-490e-8de9-13e810f3ae5b ec61940e9aae4356b3a12cf0530a6f24 54f0aa340744400f8aaec93b9c300ebe] Attempting to build 1 instance(s) from (pid=13681) schedule_run_instance /usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py:65
2012-07-11 21:16:14 DEBUG nova.compute.api [req-48c1e82f-19dc-490e-8de9-13e810f3ae5b ec61940e9aae4356b3a12cf0530a6f24 54f0aa340744400f8aaec93b9c300ebe] Searching by: {} from (pid=13681) get_all /usr/lib/python2.7/dist-packages/nova/compute/api.py:1064
2012-07-11 21:16:15 WARNING nova.scheduler.manager [req-48c1e82f-19dc-490e-8de9-13e810f3ae5b ec61940e9aae4356b3a12cf0530a6f24 54f0aa340744400f8aaec93b9c300ebe] Failed to schedule_run_instance: 'NoneType' object has no attribute 'get'
2012-07-11 21:16:15 WARNING nova.scheduler.manager [req-48c1e82f-19dc-490e-8de9-13e810f3ae5b ec61940e9aae4356b3a12cf0530a6f24 54f0aa340744400f8aaec93b9c300ebe] Setting instance 12c6e457-a5da-48e7-a2d2-32db1dc98071 to ERROR state.
2012-07-11 21:16:15 ERROR nova.rpc.amqp [req-48c1e82f-19dc-490e-8de9-13e810f3ae5b ec61940e9aae4356b3a12cf0530a6f24 54f0aa340744400f8aaec93b9c300ebe] Exception during message handling
2012-07-11 21:16:15 TRACE nova.rpc.amqp Traceback (most recent call last):
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 253, in _process_data
2012-07-11 21:16:15 TRACE nova.rpc.amqp rval = node_func(context=ctxt, **node_args)
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 115, in run_instance
2012-07-11 21:16:15 TRACE nova.rpc.amqp context, ex, *args, **kwargs)
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2012-07-11 21:16:15 TRACE nova.rpc.amqp self.gen.next()
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/scheduler/manager.py", line 105, in run_instance
2012-07-11 21:16:15 TRACE nova.rpc.amqp return self.driver.schedule_run_instance(*args, **kwargs)
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line 72, in schedule_run_instance
2012-07-11 21:16:15 TRACE nova.rpc.amqp *args, **kwargs)
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/scheduler/filter_scheduler.py", line 194, in _schedule
2012-07-11 21:16:15 TRACE nova.rpc.amqp filter_properties)
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py", line 218, in filter_hosts
2012-07-11 21:16:15 TRACE nova.rpc.amqp if host.passes_filters(filter_fns, filter_properties):
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/scheduler/host_manager.py", line 156, in passes_filters
2012-07-11 21:16:15 TRACE nova.rpc.amqp if not filter_fn(self, filter_properties):
2012-07-11 21:16:15 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/scheduler/filters/affinity_filter.py", line 64, in host_passes
2012-07-11 21:16:15 TRACE nova.rpc.amqp affinity_uuids = scheduler_hints.get('same_host', [])
2012-07-11 21:16:15 TRACE nova.rpc.amqp AttributeError: 'NoneType' object has no attribute 'get'
2012-07-11 21:16:15 TRACE nova.rpc.amqp
2012-07-11 21:17:16 DEBUG nova.rpc.amqp [-] received {u'_context_roles': [u'admin'], u'_context_request_id': u'req-aeb399b5-af7e-4e94-9476-900c6ae6dcfc', u'_context_read_deleted': u'no', u'args': {u'service_name': u'compute', u'host': u'precise-essex-allinone', u'capabilities': {u'disk_available': 6, u'vcpus_used': 0, u'hypervisor_type': u'QEMU', u'disk_total': 7, u'host_memory_free': 1159, u'vcpus': 1, u'disk_used': 1, u'host_memory_total': 1964, u'hypervisor_version': 1000000, u'cpu_info': {u'arch': u'x86_64', u'model': u'qemu64', u'vendor': u'AMD', u'features': [u'3dnowprefetch', u'misalignsse', u'sse4a', u'abm', u'cr8legacy', u'cmp_legacy', u'lahf_lm', u'3dnow', u'3dnowext', u'pdpe1gb', u'fxsr_opt', u'mmxext', u'hypervisor', u'popcnt', u'cx16', u'ht', u'vme'], u'topology': {u'cores': u'1', u'threads': u'1', u'sockets': u'1'}}}}, u'_context_auth_token': '<SANITIZED>', u'_context_is_admin': True, u'_context_project_id': None, u'_context_timestamp': u'2012-07-11T21:17:16.629745', u'_context_user_id': None, u'method': u'update_service_capabilities', u'_context_remote_address': None} from (pid=13681) _safe_log /usr/lib/python2.7/dist-packages/nova/rpc/common.py:160

Revision history for this message
Joe Breu (breu) wrote :

forgot to mention

this is on an ubuntu box from a deb install of openstack.

Revision history for this message
Vish Ishaya (vishvananda) wrote :

Already fixed in trunk: proposed the fix for stable/essex here:

https://review.openstack.org/9693

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.