neutron-lbaas broken with neutron change

Bug #1567507 reported by Rabi Mishra
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
neutron
Fix Released
Critical
Kevin Benton

Bug Description

It seems recent change https://github.com/openstack/neutron/commit/34a328fe12950c339b8259451262470c627f2f00 has broken neutron-lbaas.

Hence all dependent projects are broken with below error in q-lbaas.

2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager [req-0a3a7771-0f1e-4424-9b96-0b7613cc1c82 demo -] Create vip 7c347fc8-c282-4231-aa1c-e23a0d180abb failed on device driver haproxy_ns
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager Traceback (most recent call last):
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/agent/agent_manager.py", line 227, in create_vip
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager driver.create_vip(vip)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/namespace_driver.py", line 348, in create_vip
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager self._refresh_device(vip['pool_id'])
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/namespace_driver.py", line 344, in _refresh_device
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager if not self.deploy_instance(logical_config) and self.exists(pool_id):
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 271, in inner
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager return f(*args, **kwargs)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/namespace_driver.py", line 337, in deploy_instance
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager self.create(logical_config)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/namespace_driver.py", line 92, in create
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager logical_config['vip']['address'])
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/namespace_driver.py", line 247, in _plug
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager self.plugin_rpc.plug_vip_port(port['id'])
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/agent/agent_api.py", line 58, in plug_vip_port
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager host=self.host)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager retry=self.retry)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager timeout=timeout, retry=retry)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 470, in send
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager retry=retry)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 461, in _send
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager raise result
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager AttributeError: 'str' object has no attribute 'strftime'
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager Traceback (most recent call last):
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager incoming.message))
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager return self._do_dispatch(endpoint, method, ctxt, args)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager result = func(ctxt, **new_args)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/common/agent_driver_base.py", line 200, in plug_vip_port
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager {'port': port}
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1210, in update_port
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager port)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1301, in update_port
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager result = self._make_port_dict(port)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron/neutron/db/db_base_plugin_common.py", line 189, in _make_port_dict
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager attributes.PORTS, res, port)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron/neutron/db/common_db_mixin.py", line 271, in _apply_dict_extend_functions
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager func(*args)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron/neutron/services/timestamp/timestamp_db.py", line 103, in extend_resource_dict_timestamp
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager self._format_timestamp(resource_db, resource_res)
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager File "/opt/stack/new/neutron/neutron/services/timestamp/timestamp_db.py", line 94, in _format_timestamp
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager result['created_at'] = (resource_db.created_at.
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager AttributeError: 'str' object has no attribute 'strftime'
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager
2016-04-07 13:47:56.319 28677 ERROR neutron_lbaas.services.loadbalancer.agent.agent_manager

Changed in neutron:
importance: Undecided → Critical
tags: added: gate-failure lbaas
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (master)

Fix proposed to branch: master
Review: https://review.openstack.org/302904

Changed in neutron:
assignee: nobody → Ihar Hrachyshka (ihar-hrachyshka)
status: New → In Progress
Revision history for this message
Ihar Hrachyshka (ihar-hrachyshka) wrote :

Revert of the affecting patch: https://review.openstack.org/302904

Changed in neutron:
assignee: Ihar Hrachyshka (ihar-hrachyshka) → Jakub Libosvar (libosvar)
Changed in neutron:
assignee: Jakub Libosvar (libosvar) → Ihar Hrachyshka (ihar-hrachyshka)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/303042

Changed in neutron:
assignee: Ihar Hrachyshka (ihar-hrachyshka) → Kevin Benton (kevinbenton)
Changed in neutron:
assignee: Kevin Benton (kevinbenton) → Ihar Hrachyshka (ihar-hrachyshka)
Changed in neutron:
assignee: Ihar Hrachyshka (ihar-hrachyshka) → Kevin Benton (kevinbenton)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (master)

Reviewed: https://review.openstack.org/303042
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=6bdbff27a8327e8fc5a9897046af3aeecbbb28d2
Submitter: Jenkins
Branch: master

commit 6bdbff27a8327e8fc5a9897046af3aeecbbb28d2
Author: Kevin Benton <email address hidden>
Date: Tue Apr 5 21:03:46 2016 -0700

    Ignore timestamp fields in model update

    This adjusts the timestamp mixin to ignore the timestamp
    fields if they are passed into the DB models 'update' method
    since these should only be generated by the timestamp plugin.

    While specifying these fields is blocked at the API level, internal
    service plugins may accidentally specify them by calling an update
    method with a modified result of a get method.

    Closes-Bug: #1567507
    Change-Id: I2a10a8f15cdd5a144b172ee44fc3efd9b95d5b7e

Changed in neutron:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on neutron (master)

Change abandoned by Ihar Hrachyshka (<email address hidden>) on branch: master
Review: https://review.openstack.org/302904
Reason: The patch is not needed anymore after Kevin's fix landed.

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/neutron 9.0.0.0b1

This issue was fixed in the openstack/neutron 9.0.0.0b1 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.