Mirantis OpenStack

  1. Bug #1522429
  2. Activity log

Activity log for bug #1522429

Date Who What changed Old value New value Message
2015-12-03 14:15:36 Sergey Belous bug added bug
2015-12-03 15:04:21 Eugene Nikanorov tags neutron
2015-12-03 16:58:48 Roman Podoliaka mos: importance Undecided Medium
2015-12-03 16:58:52 Roman Podoliaka mos: status New Confirmed
2015-12-22 17:56:15 Sergey Belous mos: milestone 8.0 9.0
2016-03-16 13:33:33 Alexander Ignatov mos: importance Medium Low
2016-03-22 18:03:00 Roman Podoliaka tags neutron area-neutron
2016-03-28 11:47:26 Bug Checker Bot tags area-neutron area-neutron need-info
2016-04-01 10:57:49 Alexander Ignatov nominated for series mos/9.0.x
2016-04-01 10:57:49 Alexander Ignatov bug task added mos/9.0.x
2016-04-01 10:57:55 Alexander Ignatov mos/9.0.x: status New Confirmed
2016-04-01 10:57:58 Alexander Ignatov mos/9.0.x: importance Undecided Low
2016-04-01 10:58:00 Alexander Ignatov mos/9.0.x: status Confirmed Won't Fix
2016-04-01 10:58:08 Alexander Ignatov mos/9.0.x: assignee Sergey Belous (sbelous)
2016-04-01 10:58:12 Alexander Ignatov mos/9.0.x: milestone 9.0
2016-04-01 10:58:17 Alexander Ignatov mos: milestone 9.0 10.0
2016-04-01 10:58:27 Alexander Ignatov tags area-neutron need-info area-neutron move-to-10.0 need-info
2016-04-01 10:59:50 Sergey Belous description MOS 8.0 env, 1 compute, 3 controllers. Step to reproduce: 1. Create internal net, subnet, router. Add interface to router for created net. Boot vm in created net. 2. Create neutron-meter-label 3. Try to create meter-label-rule 4. Rule not appear in iptables on router-namespace and after that we can see traces in neutron-meter-agent logs: 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher [req-2913e1ae-87d3-404e-8897-94aa25338a67 baf05c2230204f19a700b2516b7c2786 fcab0b76df20485193be7853a28ee929 - - -] Exception during message handling: cannot concatenate 'str' and 'NoneType' objects 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last): 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback)) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 222, in add_metering_label_rule 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher 'add_metering_label_rule') 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 254, in inner 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return f(*args, **kwargs) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 176, in _invoke_driver 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return getattr(self.metering_driver, func_name)(context, meterings) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return method(*args, **kwargs) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 259, in add_metering_label_rule 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher self._add_metering_label_rule(router) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 272, in _add_metering_label_rule 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher self._process_metering_rule_action(router, 'create') 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 281, in _process_metering_rule_action 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher ext_dev = self.get_external_device_name(rm.router['gw_port_id']) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 132, in get_external_device_name 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return (EXTERNAL_DEV_PREFIX + port_id)[:self.driver.DEV_NAME_LEN] 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher TypeError: cannot concatenate 'str' and 'NoneType' objects 5. If we try to remove that meter-label-rule, we can see following traces from neutron-meter-agent: 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher [req-0bf3d3ab-ab66-4aac-a77d-95d82c3dd588 baf05c2230204f19a700b2516b7c2786 fcab0b76df20485193be7853a28ee929 - - -] Exception during message handling: cannot concatenate 'str' and 'NoneType' objects 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last): 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback)) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 226, in remove_metering_label_rule 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher 'remove_metering_label_rule') 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 254, in inner 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return f(*args, **kwargs) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 176, in _invoke_driver 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return getattr(self.metering_driver, func_name)(context, meterings) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return method(*args, **kwargs) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 264, in remove_metering_label_rule 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher self._remove_metering_label_rule(router) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 275, in _remove_metering_label_rule 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher self._process_metering_rule_action(router, 'delete') 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 281, in _process_metering_rule_action 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher ext_dev = self.get_external_device_name(rm.router['gw_port_id']) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 132, in get_external_device_name 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return (EXTERNAL_DEV_PREFIX + port_id)[:self.driver.DEV_NAME_LEN] 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher TypeError: cannot concatenate 'str' and 'NoneType' objects Upstream bug: https://bugs.launchpad.net/neutron/+bug/1527274 MOS 8.0 env, 1 compute, 3 controllers. Step to reproduce: 1. Create internal net, subnet, router. Add interface to router for created net. Boot vm in created net. 2. Create neutron-meter-label 3. Try to create meter-label-rule 4. Rule not appear in iptables on router-namespace and after that we can see traces in neutron-meter-agent logs: 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher [req-2913e1ae-87d3-404e-8897-94aa25338a67 baf05c2230204f19a700b2516b7c2786 fcab0b76df20485193be7853a28ee929 - - -] Exception during message handling: cannot concatenate 'str' and 'NoneType' objects 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last): 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback)) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 222, in add_metering_label_rule 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher 'add_metering_label_rule') 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 254, in inner 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return f(*args, **kwargs) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 176, in _invoke_driver 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return getattr(self.metering_driver, func_name)(context, meterings) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return method(*args, **kwargs) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 259, in add_metering_label_rule 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher self._add_metering_label_rule(router) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 272, in _add_metering_label_rule 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher self._process_metering_rule_action(router, 'create') 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 281, in _process_metering_rule_action 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher ext_dev = self.get_external_device_name(rm.router['gw_port_id']) 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 132, in get_external_device_name 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher return (EXTERNAL_DEV_PREFIX + port_id)[:self.driver.DEV_NAME_LEN] 2015-12-03 14:03:59.805 21341 ERROR oslo_messaging.rpc.dispatcher TypeError: cannot concatenate 'str' and 'NoneType' objects 5. If we try to remove that meter-label-rule, we can see following traces from neutron-meter-agent: 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher [req-0bf3d3ab-ab66-4aac-a77d-95d82c3dd588 baf05c2230204f19a700b2516b7c2786 fcab0b76df20485193be7853a28ee929 - - -] Exception during message handling: cannot concatenate 'str' and 'NoneType' objects 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last): 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback)) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher executor_callback) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 226, in remove_metering_label_rule 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher 'remove_metering_label_rule') 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 254, in inner 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return f(*args, **kwargs) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/agents/metering_agent.py", line 176, in _invoke_driver 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return getattr(self.metering_driver, func_name)(context, meterings) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_log/helpers.py", line 46, in wrapper 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return method(*args, **kwargs) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 264, in remove_metering_label_rule 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher self._remove_metering_label_rule(router) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 275, in _remove_metering_label_rule 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher self._process_metering_rule_action(router, 'delete') 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 281, in _process_metering_rule_action 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher ext_dev = self.get_external_device_name(rm.router['gw_port_id']) 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutron/services/metering/drivers/iptables/iptables_driver.py", line 132, in get_external_device_name 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher return (EXTERNAL_DEV_PREFIX + port_id)[:self.driver.DEV_NAME_LEN] 2015-12-03 14:07:21.595 21341 ERROR oslo_messaging.rpc.dispatcher TypeError: cannot concatenate 'str' and 'NoneType' objects
2016-07-06 13:36:56 Alexander Ignatov mos: status Confirmed Invalid