mainline 3029 - liberty - neutron commands fail with error "Service Unavailable"

Bug #1657622 reported by Sudheendra Rao
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
Trunk
Fix Committed
Critical
Ignatious Johnson Christopher

Bug Description

Neutron commands fail with error "Service Unavailable" on mainline build3029 liberty ubuntu-14.04.5

root@nodeb8:~# neutron floatingip-list
<html><body><h1>503 Service Unavailable</h1>
No server is available to handle this request.
</body></html>
root@nodeb8:

neutron server seems to be running:
root@nodeb8:~# service neutron-server status
neutron-server start/running, process 19754
root@nodeb8:~#

error trace from neutron log is:

2017-01-19 07:12:54.251 INFO [neutron.manager] Loading Plugin: neutron_plugin_contrail.plugins.opencontrail.loadbalancer.v2.plugin.LoadBalancerPluginV2
2017-01-19 07:12:54.371 ERROR [neutron.manager] Error loading plugin by name
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 144, in load_class_for_provider
    mgr = driver.DriverManager(namespace, plugin_provider)
  File "/usr/lib/python2.7/dist-packages/stevedore/driver.py", line 45, in __init__
    verify_requirements=verify_requirements,
  File "/usr/lib/python2.7/dist-packages/stevedore/named.py", line 56, in __init__
    self._init_plugins(extensions)
  File "/usr/lib/python2.7/dist-packages/stevedore/driver.py", line 97, in _init_plugins
    (self.namespace, name))
RuntimeError: No 'neutron.service_plugins' driver found, looking for 'neutron_plugin_contrail.plugins.opencontrail.loadbalancer.v2.plugin.LoadBalancerPluginV2'
2017-01-19 07:12:54.372 ERROR [neutron.manager] Error loading plugin by class
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 150, in load_class_for_provider
    plugin_class = importutils.import_class(plugin_provider)
  File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 27, in import_class
    __import__(mod_str)
  File "/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/plugins/opencontrail/loadbalancer/v2/plugin.py", line 5, in <module>
    from loadbalancer_db import LoadBalancerPluginDbV2
  File "/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/plugins/opencontrail/loadbalancer/v2/loadbalancer_db.py", line 29, in <module>
    import loadbalancer
  File "/usr/lib/python2.7/dist-packages/neutron_plugin_contrail/plugins/opencontrail/loadbalancer/v2/loadbalancer.py", line 11, in <module>
    from neutron_lib.constants import DEVICE_OWNER_LOADBALANCER
ImportError: No module named neutron_lib.constants
2017-01-19 07:12:54.373 ERROR [neutron.common.config] Unable to load neutron from configuration file /etc/neutron/api-paste.ini.
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/neutron/common/config.py", line 252, in load_paste_app
    app = deploy.loadapp("config:%s" % config_path, name=app_name)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
    return loadobj(APP, uri, name=name, **kw)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
    return context.create()
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
    return self.object_type.invoke(self)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
    **context.local_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
    val = callable(*args, **kw)
  File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
    app = loader.get_app(app_name, global_conf=global_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
    name=name, global_conf=global_conf).create()
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
    return self.object_type.invoke(self)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
    **context.local_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
    val = callable(*args, **kw)
  File "/usr/lib/python2.7/dist-packages/neutron/auth.py", line 71, in pipeline_factory
    app = loader.get_app(pipeline[-1])
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
    name=name, global_conf=global_conf).create()
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
    return self.object_type.invoke(self)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 146, in invoke
    return fix_call(context.object, context.global_conf, **context.local_conf)
  File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
    val = callable(*args, **kw)
  File "/usr/lib/python2.7/dist-packages/neutron/api/v2/router.py", line 73, in factory
    return cls(**local_config)
  File "/usr/lib/python2.7/dist-packages/neutron/api/v2/router.py", line 77, in __init__
    plugin = manager.NeutronManager.get_plugin()
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 248, in get_plugin
    return weakref.proxy(cls.get_instance().plugin)
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 242, in get_instance
    cls._create_instance()
  File "/usr/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 254, in inner
    return f(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 228, in _create_instance
    cls._instance = cls()
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 132, in __init__
    self._load_service_plugins()
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 198, in _load_service_plugins
    provider)
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 160, in _get_plugin_instance
    plugin_class = self.load_class_for_provider(namespace, plugin_provider)
  File "/usr/lib/python2.7/dist-packages/neutron/manager.py", line 156, in load_class_for_provider
    raise ImportError(_("Plugin not found."))
ImportError: Plugin not found.
2017-01-19 07:12:54.375 ERROR [neutron.service] Unrecoverable error: please check log for details.
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/neutron/service.py", line 103, in serve_wsgi
    service.start()
  File "/usr/lib/python2.7/dist-packages/neutron/service.py", line 76, in start
    self.wsgi_app = _run_wsgi(self.app_name)
  File "/usr/lib/python2.7/dist-packages/neutron/service.py", line 218, in _run_wsgi
    app = config.load_paste_app(app_name)
  File "/usr/lib/python2.7/dist-packages/neutron/common/config.py", line 259, in load_paste_app
    raise RuntimeError(msg)
RuntimeError: Unable to load neutron from configuration file /etc/neutron/api-paste.ini.

Jeba Paulaiyan (jebap)
tags: added: sanity
tags: added: blocker
Revision history for this message
Ignatious Johnson Christopher (ijohnson-x) wrote :
Revision history for this message
Ignatious Johnson Christopher (ijohnson-x) wrote :

DEVICE_OWNER_LOADBALANCER is available in neutron.common.constants module in mitaka or lower, from newton it is moved to neutron_lib.constants module.

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/28394
Submitter: Ignatious Johnson Christopher (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/28394
Committed: http://github.org/Juniper/contrail-neutron-plugin/commit/ed35c1aa8e0a23b2a2c21ae808373b38eb6214a4
Submitter: Zuul (<email address hidden>)
Branch: master

commit ed35c1aa8e0a23b2a2c21ae808373b38eb6214a4
Author: Ignatious Johnson Christopher <email address hidden>
Date: Thu Feb 2 21:58:40 2017 -0800

DEVICE_OWNER_LOADBALANCER is available in

neutron.common.constants module in mitaka or lower,
from newton it is moved to neutron_lib.constants module.

Change-Id: I070827e59a7f6537206d8bd2ecd90122de320832
Closes-Bug: 1657622

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.