This error is seen in the Tripleo CI job with this patch - https://review.openstack.org/#/c/530890/
Log - http://logs.openstack.org/90/530890/4/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/2e717ea/logs/subnode-2/var/log/containers/neutron/server.log.txt.gz?level=ERROR
2018-02-19 05:51:08.069 26 ERROR ovsdbapp.backend.ovs_idl.transaction [req-fa0771d2-96fe-4999-91c1-aed93b6528c9 822915221fd440e18398c2bb64840a96 701dadde52e44d729a2fa440c8ef4cbd - default default] Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 99, in run
txn.results.put(txn.do_commit())
File "/usr/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 86, in do_commit
command.run_idl(txn)
File "/usr/lib/python2.7/site-packages/networking_ovn/ovsdb/commands.py", line 1059, in run_idl
ovn_resource = self._get_floatingip()
File "/usr/lib/python2.7/site-packages/networking_ovn/ovsdb/commands.py", line 1035, in _get_floatingip
ext_ids = getattr(nat, 'external_ids', {})
File "/usr/lib/python2.7/site-packages/ovs/db/idl.py", line 779, in __getattr__
column = self._table.columns[column_name]
KeyError: 'external_ids'
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource [req-fa0771d2-96fe-4999-91c1-aed93b6528c9 822915221fd440e18398c2bb64840a96 701dadde52e44d729a2fa440c8ef4cbd - default default] create failed: No details.: KeyError: 'external_ids'
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource Traceback (most recent call last):
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/api/v2/resource.py", line 98, in resource
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource result = method(request=request, **args)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/api/v2/base.py", line 425, in create
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource return self._create(request, body, **kwargs)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/db/api.py", line 91, in wrapped
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource self.force_reraise()
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/db/api.py", line 87, in wrapped
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 147, in wrapper
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource self.force_reraise()
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_db/api.py", line 135, in wrapper
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/db/api.py", line 126, in wrapped
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource LOG.debug("Retry wrapper got retriable exception: %s", e)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource self.force_reraise()
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/db/api.py", line 122, in wrapped
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/api/v2/base.py", line 539, in _create
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource obj = do_create(body)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/api/v2/base.py", line 521, in do_create
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource request.context, reservation.reservation_id)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource self.force_reraise()
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/neutron/api/v2/base.py", line 514, in do_create
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource return obj_creator(request.context, **kwargs)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/networking_ovn/l3/l3_ovn.py", line 265, in create_floatingip
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource self._ovn_client.create_floatingip(fip)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/networking_ovn/common/ovn_client.py", line 626, in create_floatingip
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource const.FLOATINGIP_STATUS_ACTIVE)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/networking_ovn/l3/l3_ovn.py", line 291, in update_floatingip_status
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource self._ovn_client.update_floatingip_status(fip)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib/python2.7/site-packages/networking_ovn/common/ovn_client.py", line 605, in update_floatingip_status
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource txn.add(check_rev_cmd)
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__
2018-02-19 05:51:08.088 26 ERROR neutron.api.v2.resource self.gen.next()
Hi Numan,
This is a dup of https:/ /bugs.launchpad .net/tripleo/ +bug/1740698
The problem with [0] is that no matter how many times we recheck, we need an RDO promotion to happen so that we can have the fix [1].
[0] https:/ /review. openstack. org/#/c/ 530890/ /review. openstack. org/#/c/ 538173/
[1] https:/