_poll_bandwidth_usage task fails to create bw usage object with TypeError

[Matt Riedemann]

I noticed this in the logs of a citrix xenserver CI job run:

http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/15/210515/1/7541//logs/screen-n-cpu.txt.gz

2015-08-07 17:05:19.168 ERROR oslo_service.periodic_task [req-129cdac2-1a3a-458c-ab38-7eeebcea9672 None None] Error during ComputeManager._poll_bandwidth_usage
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task Traceback (most recent call last):
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py", line 218, in run_periodic_tasks
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task task(self, context)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/opt/stack/new/nova/nova/compute/manager.py", line 5680, in _poll_bandwidth_usage
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task update_cells=update_cells)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/opt/stack/new/nova/nova/objects/base.py", line 493, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task return fn(obj, *args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 195, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task ctxt, self, fn.__name__, args, kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/opt/stack/new/nova/nova/conductor/rpcapi.py", line 248, in object_action
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task objmethod=objmethod, args=args, kwargs=kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task retry=self.retry)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task timeout=timeout, retry=retry)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task retry=retry)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 422, in _send
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task raise result
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task TypeError: 'NoneType' object has no attribute '__getitem__'
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task Traceback (most recent call last):
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/opt/stack/new/nova/nova/conductor/manager.py", line 442, in _object_dispatch
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task return getattr(target, method)(*args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/opt/stack/new/nova/nova/objects/base.py", line 493, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task return fn(obj, *args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 211, in wrapper
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task return fn(self, *args, **kwargs)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/opt/stack/new/nova/nova/objects/bandwidth_usage.py", line 69, in create
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task self._from_db_object(self._context, self, db_bw_usage)
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task File "/opt/stack/new/nova/nova/objects/bandwidth_usage.py", line 42, in _from_db_object
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task bw_usage[field] = db_bw_usage['uuid']
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task TypeError: 'NoneType' object has no attribute '__getitem__'
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task
2015-08-07 17:05:19.168 13318 ERROR oslo_service.periodic_task

The only thing I can think that broke it is https://review.openstack.org/#/c/189397/ but that merged awhile ago.

Otherwise there could be some regression in oslo.versionedobjects 0.7.0 since that was released on 8/3.

[Matt Riedemann (mriedem)]

Sounds like https://review.openstack.org/#/c/172524/ should fix this.