various tempest test failure

Bug #1592359 reported by YAMAMOTO Takashi
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
networking-midonet
Fix Released
Critical
YAMAMOTO Takashi

Bug Description

http://logs.openstack.org/13/325713/10/check/gate-tempest-dsvm-networking-midonet-v2/6850d7f/logs/screen-q-svc.txt.gz

2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource [req-6dac4200-b728-45b2-a2ac-c42f860f34fc tempest-TestFWaaS-956690234 -] update failed
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource Traceback (most recent call last):
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 78, in resource
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource result = method(request=request, **args)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 596, in update
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource return self._update(request, id, body, **kwargs)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 148, in wrapper
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 221, in __exit__
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource self.force_reraise()
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 197, in force_reraise
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 138, in wrapper
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 642, in _update
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource obj = obj_updater(request.context, id, **kwargs)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py", line 48, in wrapper
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource return method(*args, **kwargs)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/networking-midonet/midonet/neutron/services/l3/l3_midonet.py", line 126, in update_router
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource router)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/extraroute_db.py", line 76, in update_router
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource context, id, router)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 1649, in update_router
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource id, router)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 265, in update_router
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource self._update_router_gw_info(context, id, gw_info)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_gwmode_db.py", line 69, in _update_router_gw_info
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource context, router_id, info, router=router)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 479, in _update_router_gw_info
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource ext_ips)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 449, in _create_gw_port
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource new_network_id, ext_ips)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 350, in _create_router_gw_port
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource context.elevated(), {'port': port_data})
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/plugins/common/utils.py", line 164, in create_port
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource return core_plugin.create_port(context, {'port': port_data})
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/networking-midonet/midonet/neutron/plugin_v2.py", line 245, in create_port
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource new_port = super(MidonetPluginV2, self).create_port(context, port)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1207, in create_port
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource db_port = self.create_port_db(context, port)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1248, in create_port_db
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource port_id)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/ipam_non_pluggable_backend.py", line 225, in allocate_ips_for_port_and_store
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource subnet_id, port_id)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/opt/stack/new/neutron/neutron/db/db_base_plugin_common.py", line 114, in _store_ip_allocation
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource context.session.flush()
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2019, in flush
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource self._flush(objects)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2137, in _flush
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource transaction.rollback(_capture_exception=True)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource compat.reraise(exc_type, exc_value, exc_tb)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2101, in _flush
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource flush_context.execute()
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource rec.execute(self)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource uow
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource mapper, table, insert)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 767, in _emit_insert_statements
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource execute(statement, multiparams)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource return meth(self, multiparams, params)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource return connection._execute_clauseelement(self, multiparams, params)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource compiled_sql, distilled_params
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource context)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource util.raise_from_cause(newraise, exc_info)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 202, in raise_from_cause
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource reraise(type(exception), exception, tb=exc_tb, cause=cause)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource context)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource cursor.execute(statement, parameters)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/cursors.py", line 161, in execute
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource result = self._query(query)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/cursors.py", line 317, in _query
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource conn.query(q)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 835, in query
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 1019, in _read_query_result
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource result.read()
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 1302, in read
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource first_packet = self.connection._read_packet()
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 981, in _read_packet
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource packet.check_error()
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource err.raise_mysql_exception(self._data)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource _check_mysql_exception(errinfo)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource File "/usr/local/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource raise errorclass(errno, errorvalue)
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, u"Duplicate entry '172.24.5.8-bec0fb08-ac51-487c-8f94-e17acc3e795d-bec416cf-bb9a-47' for key 'PRIMARY'") [SQL: u'INSERT INTO ipallocations (port_id, ip_address, subnet_id, network_id) VALUES (%(port_id)s, %(ip_address)s, %(subnet_id)s, %(network_id)s)'] [parameters: {'subnet_id': u'bec0fb08-ac51-487c-8f94-e17acc3e795d', 'network_id': u'bec416cf-bb9a-47cc-ba58-0eef1daf6490', 'port_id': 'b0d0bdaf-ae30-4a82-91b4-02b5d927c49e', 'ip_address': '172.24.5.8'}]
2016-06-14 09:26:08.013 16553 ERROR neutron.api.v2.resource

Revision history for this message
YAMAMOTO Takashi (yamamoto) wrote :
Changed in networking-midonet:
assignee: nobody → YAMAMOTO Takashi (yamamoto)
importance: Undecided → Critical
milestone: none → 2.0.0
status: New → In Progress
summary: - fwaas test failure
+ various tempest test failure
tags: added: liberty-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to networking-midonet (master)

Reviewed: https://review.openstack.org/329391
Committed: https://git.openstack.org/cgit/openstack/networking-midonet/commit/?id=63fa37c42b10d9a3910d89781adf34101288b2cb
Submitter: Jenkins
Branch: master

commit 63fa37c42b10d9a3910d89781adf34101288b2cb
Author: YAMAMOTO Takashi <email address hidden>
Date: Tue Jun 14 20:40:46 2016 +0900

    Retry on DBDuplicateEntry

    The recent Neutron change [1] seems to expect the core plugin
    retries the operation on the exception.

    [1] I52e4485e832cbe6798de6b4afb6a7cfd88db11e2

    Related ML2 change: I37a964497bf60a61bc49bdeec94a008f167c384f
    Closes-Bug: #1592359
    Change-Id: I51beae80d78ae6b74fc72dad20440629ccbe1a2b

Changed in networking-midonet:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.