networking-calico

Subnet create fails on Ocata Neutron

Bug #1644672 reported by Logan V
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
networking-calico
Fix Released
Undecided
Nell Jerram

Bug Description

This is on Ocata Neutron:
neutron @ e3258fcd6488422c31683f9ba087ec06d4eeb5f0 (master as of 11/24/2016)
felix @ 1.4.4 tag
networking_calico @ 876b37fadf0e03ba6323ba2bfd2aeeb4597a9f6d (master as of 11/24/2016)

2016-11-25 00:22:51.084 32519 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [req-81960612-640c-4589-b012-60027875020d 6591ad635d0b4eb09184ecd3c3881294 89fd67e063de431684a381086cc04335 - - -] Doing Calico mechanism driver initialisation inprocess 32519
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico [req-81960612-640c-4589-b012-60027875020d 6591ad635d0b4eb09184ecd3c3881294 89fd67e063de431684a381086cc04335 - - -] Exception in function %s
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico Traceback (most recent call last):
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/logutils.py", line 21, in wrapped
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico return fn(*args, **kwargs)
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/plugins/ml2/drivers/calico/mech_calico.py", line 258, in _init_state
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico self._get_db()
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/plugins/ml2/drivers/calico/mech_calico.py", line 478, in _get_db
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico self.db = manager.NeutronManager.get_plugin()
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico AttributeError: type object 'NeutronManager' has no attribute 'get_plugin'
2016-11-25 00:22:51.084 32519 ERROR networking_calico.plugins.ml2.drivers.calico.mech_calico
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers [req-81960612-640c-4589-b012-60027875020d 6591ad635d0b4eb09184ecd3c3881294 89fd67e063de431684a381086cc04335 - - -] Mechanism driver 'calico' failed in delete_subnet_postcommit
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers Traceback (most recent call last):
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/plugins/ml2/managers.py", line 433, in _call_on_drivers
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context)
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/plugins/ml2/drivers/calico/mech_calico.py", line 159, in wrapper
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers return f(self, *args, **kwargs)
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/plugins/ml2/drivers/calico/mech_calico.py", line 134, in wrapper
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers self._init_state()
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/logutils.py", line 21, in wrapped
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers return fn(*args, **kwargs)
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/plugins/ml2/drivers/calico/mech_calico.py", line 258, in _init_state
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers self._get_db()
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/networking_calico/plugins/ml2/drivers/calico/mech_calico.py", line 478, in _get_db
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers self.db = manager.NeutronManager.get_plugin()
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers AttributeError: type object 'NeutronManager' has no attribute 'get_plugin'
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.managers
2016-11-25 00:22:51.085 32519 ERROR neutron.plugins.ml2.plugin [req-81960612-640c-4589-b012-60027875020d 6591ad635d0b4eb09184ecd3c3881294 89fd67e063de431684a381086cc04335 - - -] mechanism_manager.delete_subnet_postcommit failed
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource [req-81960612-640c-4589-b012-60027875020d 6591ad635d0b4eb09184ecd3c3881294 89fd67e063de431684a381086cc04335 - - -] create failed: No details.
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource Traceback (most recent call last):
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/api/v2/resource.py", line 79, in resource
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource result = method(request=request, **args)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/api/v2/base.py", line 438, in create
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return self._create(request, body, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 92, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 88, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_db/api.py", line 151, in wrapper
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_db/api.py", line 139, in wrapper
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 128, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource traceback.format_exc())
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 123, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/api/v2/base.py", line 551, in _create
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource obj = do_create(body)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/api/v2/base.py", line 533, in do_create
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource request.context, reservation.reservation_id)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/api/v2/base.py", line 526, in do_create
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return obj_creator(request.context, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/common/utils.py", line 699, in inner
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return f(self, context, *args, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 163, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return method(*args, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 92, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource setattr(e, '_RETRY_EXCEEDED', True)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 88, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_db/api.py", line 151, in wrapper
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource ectxt.value = e.inner_exc
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_db/api.py", line 139, in wrapper
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return f(*args, **kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 128, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource traceback.format_exc())
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/db/api.py", line 123, in wrapped
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource return f(*dup_args, **dup_kwargs)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/plugins/ml2/plugin.py", line 1017, in create_subnet
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.delete_subnet(context, result['id'])
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.force_reraise()
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource six.reraise(self.type_, self.value, self.tb)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/plugins/ml2/plugin.py", line 1012, in create_subnet
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self.mechanism_manager.create_subnet_postcommit(mech_context)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/plugins/ml2/managers.py", line 577, in create_subnet_postcommit
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource self._call_on_drivers("create_subnet_postcommit", context)
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource File "/openstack/venvs/neutron-testing/local/lib/python2.7/site-packages/neutron/plugins/ml2/managers.py", line 451, in _call_on_drivers
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource errors=errors
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource MechanismDriverError
2016-11-25 00:22:51.093 32519 ERROR neutron.api.v2.resource

Revision history for this message
Nell Jerram (neil-jerram) wrote :

Thanks for reporting, Logan. This looks like it's because of http://lists.openstack.org/pipermail/openstack-dev/2016-November/107388.html.

Are you looking at a fix for this, or planning to? If so, please leave a note here first, so that we don't duplicate.

Revision history for this message
Logan V (loganv) wrote :

Will do.. I can't take this bug currently but if I get to it before someone else I will self assign when I start the work so we can avoid duplicating.

Revision history for this message
Nell Jerram (neil-jerram) wrote :

FYI I'm looking at this now.

OpenStack Infra (hudson-openstack)
Changed in networking-calico:
assignee: nobody → Neil Jerram (neil-jerram)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to networking-calico (master)

Reviewed: https://review.openstack.org/404849
Committed: https://git.openstack.org/cgit/openstack/networking-calico/commit/?id=6d173ab437cf5915eb7874d2c1622710e3e28766
Submitter: Jenkins
Branch: master

commit 6d173ab437cf5915eb7874d2c1622710e3e28766
Author: Neil Jerram <email address hidden>
Date: Wed Nov 30 15:59:11 2016 +0000

    Handle recent removal of NeutronManager.get_plugin()

    (As announced in
    http://lists.openstack.org/pipermail/openstack-dev/2016-November/107388.html)

    Also improve how the DevStack plugin settings detect whether to install
    a single combined node or a compute-only node, as the setting of
    SERVICE_HOST seems to have just changed from being an IP to being a
    hostname, when running in OpenStack CI.

    Closes-Bug: #1644672
    Change-Id: Id2a87147541ddf418de15cce87a019567ac3182a

Changed in networking-calico:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.