Liberty - neutron service failure when openstack and cfgm are on different nodes

Bug #1561808 reported by Jeba Paulaiyan
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0
Fix Committed
Critical
amudhar
R3.1
Fix Committed
Critical
amudhar
Trunk
Fix Committed
Critical
amudhar

Bug Description

3.0.0.0 liberty

Openstack and Neutron are on different nodes. neutron service failed to function.

Ajay debugged, root caused this and suggested the fix as follows:

https://github.com/Juniper/contrail-provisioning/commit/1830ec6a97f03b03b7de656de3d53c5ab1ab279b#diff-55b991823ddefefb3b53d5ae97d61ae7R104

instead of nova-api dpkg -l | grep 'ii' | grep neutron-server | awk '{print $3}'
 if [[ $neutron_server_version == *"12.0.0"* ]]; then should instead be *"7.0.0-0"*

Traceback from neutron-server.log

2016-03-25 07:01:49.257 CRITICAL [neutron] ExtensionsNotFound: Extensions not found: ['lbaas']
Traceback (most recent call last):
  File "/usr/bin/neutron-server", line 10, in <module>
    sys.exit(main_wsgi_eventlet())
  File "/usr/lib/python2.7/dist-packages/neutron/cmd/eventlet/server/__init__.py", line 19, in main_wsgi_eventlet
    wsgi_eventlet.main()
  File "/usr/lib/python2.7/dist-packages/neutron/server/wsgi_eventlet.py", line 51, in main
    server.boot_server(_eventlet_wsgi_server)
  File "/usr/lib/python2.7/dist-packages/neutron/server/__init__.py", line 35, in boot_server
    server_func()
  File "/usr/lib/python2.7/dist-packages/neutron/server/wsgi_eventlet.py", line 28, in _eventlet_wsgi_server
    neutron_api = service.serve_wsgi(service.NeutronApiService)
  File "/usr/lib/python2.7/dist-packages/neutron/service.py", line 106, in serve_wsgi
    LOG.exception(_LE('Unrecoverable error: please check log '
  File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 195, in __exit__
    six.reraise(self.type_, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/neutron/service.py", line 103, in serve_wsgi
    service.start()
  File "/usr/lib/python2.7/dist-packages/neutron/service.py", line 76, in start
    self.wsgi_app = _run_wsgi(self.app_name)
  File "/usr/lib/python2.7/dist-packages/neutron/service.py", line 208, in _run_wsgi
    app = config.load_paste_app(app_name)
  File "/usr/lib/python2.7/dist-packages/neutron/common/config.py", line 246, in load_paste_app
    app = deploy.loadapp("config:%s" % config_path, name=app_name)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
    return loadobj(APP, uri, name=name, **kw)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
    return context.create()
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
    return self.object_type.invoke(self)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
    **context.local_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
    val = callable(*args, **kw)
  File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
    app = loader.get_app(app_name, global_conf=global_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
    name=name, global_conf=global_conf).create()
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
    return self.object_type.invoke(self)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
    **context.local_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
    val = callable(*args, **kw)
  File "/usr/lib/python2.7/dist-packages/neutron/auth.py", line 71, in pipeline_factory
    app = loader.get_app(pipeline[-1])
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
    name=name, global_conf=global_conf).create()
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
    return self.object_type.invoke(self)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 146, in invoke
    return fix_call(context.object, context.global_conf, **context.local_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
    val = callable(*args, **kw)
  File "/usr/lib/python2.7/dist-packages/neutron/api/v2/router.py", line 73, in factory
    return cls(**local_config)
  File "/usr/lib/python2.7/dist-packages/neutron/api/v2/router.py", line 78, in __init__
    ext_mgr = extensions.PluginAwareExtensionManager.get_instance()
  File "/usr/lib/python2.7/dist-packages/neutron/api/extensions.py", line 585, in get_instance
    service_plugins)
  File "/usr/lib/python2.7/dist-packages/neutron/api/extensions.py", line 550, in __init__
    self.check_if_plugin_extensions_loaded()
  File "/usr/lib/python2.7/dist-packages/neutron/api/extensions.py", line 614, in check_if_plugin_extensions_loaded
    extensions=list(missing_aliases))
ExtensionsNotFound: Extensions not found: ['lbaas']

Tags: blocker config
Jeba Paulaiyan (jebap)
tags: added: blocker
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/18773
Submitter: Rudra Rugge (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.0

Review in progress for https://review.opencontrail.org/18774
Submitter: Rudra Rugge (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/18775
Submitter: Rudra Rugge (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.0

Review in progress for https://review.opencontrail.org/18776
Submitter: Rudra Rugge (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/18774
Committed: http://github.org/Juniper/contrail-neutron-plugin/commit/602d4877c006009f708165029a780258f0e904ab
Submitter: Zuul
Branch: R3.0

commit 602d4877c006009f708165029a780258f0e904ab
Author: Rudra Rugge <email address hidden>
Date: Fri Mar 25 10:16:51 2016 -0700

Fix LBAASv1 import for liberty

Import uuidutils from oslo instead of neutron

Change-Id: I2911599f7b1b8cfb681a4b366a6d39ba90ec48f6
Partial-Bug: 1561808

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/18776
Committed: http://github.org/Juniper/contrail-provisioning/commit/56bcdef52804c9bb3844898da1d4b7aeb3ebb188
Submitter: Zuul
Branch: R3.0

commit 56bcdef52804c9bb3844898da1d4b7aeb3ebb188
Author: Rudra Rugge <email address hidden>
Date: Fri Mar 25 10:22:03 2016 -0700

Enable only LBAASv1 for liberty 3.0.1

Enable only LBAASv1 for liberty 3.0.1

Change-Id: Ic325501ac2abf906bc139a6426c0f0d1cf0b3c6b
Closes-Bug: 1561808

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/18854
Submitter: Rudra Rugge (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/18854
Committed: http://github.org/Juniper/contrail-neutron-plugin/commit/3f18ad707721a83828f1dc75aee1d7a2a5292653
Submitter: Zuul
Branch: master

commit 3f18ad707721a83828f1dc75aee1d7a2a5292653
Author: Rudra Rugge <email address hidden>
Date: Fri Mar 25 10:16:51 2016 -0700

Fix LBAASv1 import for liberty

Import uuidutils from oslo instead of neutron

Change-Id: If0cf90518cc05ebb4c5fcf3795679af7ed3c9dca
Partial-Bug: 1561808

Revision history for this message
Sudheendra Rao (sudheendra-k) wrote :

Problem is seen on R3.1 build 43 also for redhat liberty.

Revision history for this message
Jeba Paulaiyan (jebap) wrote :

As per Amudha, this fix is already present in R3.1 branch. So removing 3.1.1.0 milestone from this bug. Further issues can be tracked after root causing.

Revision history for this message
amudhar (amudha) wrote :

Fix exists on 3.1 branch.
Please open a different tracking bug if issue exists on redhat liberty.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.