Pike fails to stack with cisco_router service-plugin enabled due to cisco_router_plugin use of l3_db._notify_routers_callback

Bug #1737004 reported by Timothy Swanson
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
networking-cisco
Fix Released
Undecided
Bob Melander

Bug Description

Neutron-server crashes during Pike devstack bringup due to the cisco_router_plugin.

See logs: http://192.133.156.18/64/517164/2/experimental/gate-networking-cisco-dsvm-tempest-smoke-asr1k-pike-centos-7-asr/7e719ba/logs/screen-q-svc.txt.gz?level=ERROR

Traceback:

Dec 07 15:50:15.858846 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service [None req-160ee0cb-f209-499e-9590-79184df4d7e0 None None] Unrecoverable error: please check log for details.: AttributeError: 'module' object has no attribute '_notify_routers_callback'
Dec 07 15:50:15.859077 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service Traceback (most recent call last):
Dec 07 15:50:15.859322 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/service.py", line 86, in serve_wsgi
Dec 07 15:50:15.859542 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service service.start()
Dec 07 15:50:15.859738 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/service.py", line 62, in start
Dec 07 15:50:15.859950 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service self.wsgi_app = _run_wsgi(self.app_name)
Dec 07 15:50:15.860203 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/service.py", line 289, in _run_wsgi
Dec 07 15:50:15.860419 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service app = config.load_paste_app(app_name)
Dec 07 15:50:15.860610 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/common/config.py", line 122, in load_paste_app
Dec 07 15:50:15.860785 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service app = loader.load_app(app_name)
Dec 07 15:50:15.860966 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/oslo_service/wsgi.py", line 353, in load_app
Dec 07 15:50:15.861157 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return deploy.loadapp("config:%s" % self.config_path, name=name)
Dec 07 15:50:15.861355 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Dec 07 15:50:15.861543 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return loadobj(APP, uri, name=name, **kw)
Dec 07 15:50:15.861750 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Dec 07 15:50:15.861929 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return context.create()
Dec 07 15:50:15.862122 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
Dec 07 15:50:15.862328 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return self.object_type.invoke(self)
Dec 07 15:50:15.862511 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Dec 07 15:50:15.862715 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service **context.local_conf)
Dec 07 15:50:15.862940 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
Dec 07 15:50:15.863144 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service val = callable(*args, **kw)
Dec 07 15:50:15.863339 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/urlmap.py", line 31, in urlmap_factory
Dec 07 15:50:15.863488 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service app = loader.get_app(app_name, global_conf=global_conf)
Dec 07 15:50:15.863624 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Dec 07 15:50:15.863782 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service name=name, global_conf=global_conf).create()
Dec 07 15:50:15.863907 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
Dec 07 15:50:15.864056 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return self.object_type.invoke(self)
Dec 07 15:50:15.864194 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Dec 07 15:50:15.864328 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service **context.local_conf)
Dec 07 15:50:15.864449 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
Dec 07 15:50:15.864569 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service val = callable(*args, **kw)
Dec 07 15:50:15.864692 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/auth.py", line 47, in pipeline_factory
Dec 07 15:50:15.864817 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service app = loader.get_app(pipeline[-1])
Dec 07 15:50:15.864978 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Dec 07 15:50:15.865120 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service name=name, global_conf=global_conf).create()
Dec 07 15:50:15.865258 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
Dec 07 15:50:15.865393 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return self.object_type.invoke(self)
Dec 07 15:50:15.865518 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 146, in invoke
Dec 07 15:50:15.865652 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return fix_call(context.object, context.global_conf, **context.local_conf)
Dec 07 15:50:15.865784 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
Dec 07 15:50:15.865907 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service val = callable(*args, **kw)
Dec 07 15:50:15.866044 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/api/v2/router.py", line 71, in factory
Dec 07 15:50:15.866180 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return pecan_app.v2_factory(global_config, **local_config)
Dec 07 15:50:15.866314 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/pecan_wsgi/app.py", line 47, in v2_factory
Dec 07 15:50:15.866441 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service startup.initialize_all()
Dec 07 15:50:15.866569 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/pecan_wsgi/startup.py", line 39, in initialize_all
Dec 07 15:50:15.866690 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service manager.init()
Dec 07 15:50:15.866820 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/manager.py", line 296, in init
Dec 07 15:50:15.866952 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service NeutronManager.get_instance()
Dec 07 15:50:15.867089 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/manager.py", line 247, in get_instance
Dec 07 15:50:15.867224 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service cls._create_instance()
Dec 07 15:50:15.867357 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 271, in inner
Dec 07 15:50:15.867481 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service return f(*args, **kwargs)
Dec 07 15:50:15.867614 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/manager.py", line 233, in _create_instance
Dec 07 15:50:15.867754 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service cls._instance = cls()
Dec 07 15:50:15.867887 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/manager.py", line 141, in __init__
Dec 07 15:50:15.868042 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service self._load_service_plugins()
Dec 07 15:50:15.868255 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/manager.py", line 203, in _load_service_plugins
Dec 07 15:50:15.868392 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service provider)
Dec 07 15:50:15.868523 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/manager.py", line 165, in _get_plugin_instance
Dec 07 15:50:15.868644 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service plugin_class = self.load_class_for_provider(namespace, plugin_provider)
Dec 07 15:50:15.868791 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/manager.py", line 159, in load_class_for_provider
Dec 07 15:50:15.868912 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service plugin_provider)
Dec 07 15:50:15.869064 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/neutron/neutron/common/utils.py", line 321, in load_class_by_alias_or_classname
Dec 07 15:50:15.869193 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service class_to_load = importutils.import_class(name)
Dec 07 15:50:15.869340 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 30, in import_class
Dec 07 15:50:15.869463 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service __import__(mod_str)
Dec 07 15:50:15.869593 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/networking-cisco/networking_cisco/plugins/cisco/service_plugins/cisco_router_plugin.py", line 29, in <module>
Dec 07 15:50:15.869717 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service from networking_cisco.plugins.cisco.db.l3 import l3_router_appliance_db
Dec 07 15:50:15.869846 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/networking-cisco/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 1616, in <module>
Dec 07 15:50:15.869969 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service modify_subscribe()
Dec 07 15:50:15.870109 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service File "/opt/stack/new/networking-cisco/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 1603, in modify_subscribe
Dec 07 15:50:15.870236 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service registry.unsubscribe(l3_db._notify_routers_callback, resources.PORT,
Dec 07 15:50:15.870411 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service AttributeError: 'module' object has no attribute '_notify_routers_callback'
Dec 07 15:50:15.870532 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron.service
Dec 07 15:50:15.870658 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: CRITICAL neutron [None req-160ee0cb-f209-499e-9590-79184df4d7e0 None None] Unhandled error: AttributeError: 'module' object has no attribute '_notify_routers_callback'
Dec 07 15:50:15.870777 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron Traceback (most recent call last):
Dec 07 15:50:15.870922 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/bin/neutron-server", line 10, in <module>
Dec 07 15:50:15.871066 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron sys.exit(main())
Dec 07 15:50:15.871192 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/cmd/eventlet/server/__init__.py", line 19, in main
Dec 07 15:50:15.871327 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron server.boot_server(wsgi_eventlet.eventlet_wsgi_server)
Dec 07 15:50:15.871448 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/server/__init__.py", line 42, in boot_server
Dec 07 15:50:15.871580 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron server_func()
Dec 07 15:50:15.871700 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/server/wsgi_eventlet.py", line 24, in eventlet_wsgi_server
Dec 07 15:50:15.871828 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron neutron_api = service.serve_wsgi(service.NeutronApiService)
Dec 07 15:50:15.871951 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/service.py", line 89, in serve_wsgi
Dec 07 15:50:15.872084 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron LOG.exception('Unrecoverable error: please check log '
Dec 07 15:50:15.872233 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
Dec 07 15:50:15.872375 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron self.force_reraise()
Dec 07 15:50:15.872501 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
Dec 07 15:50:15.872629 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron six.reraise(self.type_, self.value, self.tb)
Dec 07 15:50:15.872760 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/service.py", line 86, in serve_wsgi
Dec 07 15:50:15.872883 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron service.start()
Dec 07 15:50:15.873005 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/service.py", line 62, in start
Dec 07 15:50:15.873146 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron self.wsgi_app = _run_wsgi(self.app_name)
Dec 07 15:50:15.873336 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/service.py", line 289, in _run_wsgi
Dec 07 15:50:15.873468 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron app = config.load_paste_app(app_name)
Dec 07 15:50:15.873599 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/common/config.py", line 122, in load_paste_app
Dec 07 15:50:15.873731 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron app = loader.load_app(app_name)
Dec 07 15:50:15.873860 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_service/wsgi.py", line 353, in load_app
Dec 07 15:50:15.873989 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return deploy.loadapp("config:%s" % self.config_path, name=name)
Dec 07 15:50:15.874129 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Dec 07 15:50:15.874272 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return loadobj(APP, uri, name=name, **kw)
Dec 07 15:50:15.874406 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Dec 07 15:50:15.874566 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return context.create()
Dec 07 15:50:15.874694 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
Dec 07 15:50:15.874820 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return self.object_type.invoke(self)
Dec 07 15:50:15.874951 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Dec 07 15:50:15.875095 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron **context.local_conf)
Dec 07 15:50:15.875217 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
Dec 07 15:50:15.875359 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron val = callable(*args, **kw)
Dec 07 15:50:15.875498 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/urlmap.py", line 31, in urlmap_factory
Dec 07 15:50:15.875618 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron app = loader.get_app(app_name, global_conf=global_conf)
Dec 07 15:50:15.875745 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Dec 07 15:50:15.875879 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron name=name, global_conf=global_conf).create()
Dec 07 15:50:15.876017 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
Dec 07 15:50:15.876166 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return self.object_type.invoke(self)
Dec 07 15:50:15.876309 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Dec 07 15:50:15.876435 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron **context.local_conf)
Dec 07 15:50:15.876552 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
Dec 07 15:50:15.876670 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron val = callable(*args, **kw)
Dec 07 15:50:15.876787 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/auth.py", line 47, in pipeline_factory
Dec 07 15:50:15.876926 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron app = loader.get_app(pipeline[-1])
Dec 07 15:50:15.877086 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Dec 07 15:50:15.877211 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron name=name, global_conf=global_conf).create()
Dec 07 15:50:15.877343 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 710, in create
Dec 07 15:50:15.877465 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return self.object_type.invoke(self)
Dec 07 15:50:15.877584 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/loadwsgi.py", line 146, in invoke
Dec 07 15:50:15.877705 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return fix_call(context.object, context.global_conf, **context.local_conf)
Dec 07 15:50:15.877826 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/paste/deploy/util.py", line 55, in fix_call
Dec 07 15:50:15.877945 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron val = callable(*args, **kw)
Dec 07 15:50:15.878089 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/api/v2/router.py", line 71, in factory
Dec 07 15:50:15.878220 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return pecan_app.v2_factory(global_config, **local_config)
Dec 07 15:50:15.878353 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/pecan_wsgi/app.py", line 47, in v2_factory
Dec 07 15:50:15.878507 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron startup.initialize_all()
Dec 07 15:50:15.878631 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/pecan_wsgi/startup.py", line 39, in initialize_all
Dec 07 15:50:15.878755 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron manager.init()
Dec 07 15:50:15.878874 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/manager.py", line 296, in init
Dec 07 15:50:15.879002 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron NeutronManager.get_instance()
Dec 07 15:50:15.879134 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/manager.py", line 247, in get_instance
Dec 07 15:50:15.879272 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron cls._create_instance()
Dec 07 15:50:15.879395 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 271, in inner
Dec 07 15:50:15.879517 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron return f(*args, **kwargs)
Dec 07 15:50:15.879645 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/manager.py", line 233, in _create_instance
Dec 07 15:50:15.879767 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron cls._instance = cls()
Dec 07 15:50:15.879899 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/manager.py", line 141, in __init__
Dec 07 15:50:15.880050 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron self._load_service_plugins()
Dec 07 15:50:15.880195 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/manager.py", line 203, in _load_service_plugins
Dec 07 15:50:15.880368 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron provider)
Dec 07 15:50:15.880497 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/manager.py", line 165, in _get_plugin_instance
Dec 07 15:50:15.880615 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron plugin_class = self.load_class_for_provider(namespace, plugin_provider)
Dec 07 15:50:15.880746 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/manager.py", line 159, in load_class_for_provider
Dec 07 15:50:15.880873 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron plugin_provider)
Dec 07 15:50:15.881027 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/neutron/neutron/common/utils.py", line 321, in load_class_by_alias_or_classname
Dec 07 15:50:15.881169 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron class_to_load = importutils.import_class(name)
Dec 07 15:50:15.881369 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 30, in import_class
Dec 07 15:50:15.881494 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron __import__(mod_str)
Dec 07 15:50:15.881618 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/networking-cisco/networking_cisco/plugins/cisco/service_plugins/cisco_router_plugin.py", line 29, in <module>
Dec 07 15:50:15.881752 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron from networking_cisco.plugins.cisco.db.l3 import l3_router_appliance_db
Dec 07 15:50:15.881872 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/networking-cisco/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 1616, in <module>
Dec 07 15:50:15.881995 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron modify_subscribe()
Dec 07 15:50:15.882115 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron File "/opt/stack/new/networking-cisco/networking_cisco/plugins/cisco/db/l3/l3_router_appliance_db.py", line 1603, in modify_subscribe
Dec 07 15:50:15.882241 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron registry.unsubscribe(l3_db._notify_routers_callback, resources.PORT,
Dec 07 15:50:15.882441 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron AttributeError: 'module' object has no attribute '_notify_routers_callback'
Dec 07 15:50:15.882564 centos-7-asr-devstack-rocket-man-asr-206923 neutron-server[18433]: ERROR neutron
Dec 07 15:50:16.007412 centos-7-asr-devstack-rocket-man-asr-206923 systemd[1]: <email address hidden>: main process exited, code=exited, status=1/FAILURE
Dec 07 15:50:16.008463 centos-7-asr-devstack-rocket-man-asr-206923 systemd[1]: Unit <email address hidden> entered failed state.
Dec 07 15:50:16.008847 centos-7-asr-devstack-rocket-man-asr-206923 systemd[1]: <email address hidden> failed.

Tags: asr1k
tags: added: asr1k
Revision history for this message
Timothy Swanson (tiswanso) wrote :

This neutron commit looks like what's affecting this for the plugin:

https://review.openstack.org/#/c/442354

Changed in networking-cisco:
assignee: nobody → Bob Melander (bob-melander)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to networking-cisco (master)

Reviewed: https://review.openstack.org/529307
Committed: https://git.openstack.org/cgit/openstack/networking-cisco/commit/?id=49c2ed1975adcb0dfe8074da0fb3d330f1cb440c
Submitter: Zuul
Branch: master

commit 49c2ed1975adcb0dfe8074da0fb3d330f1cb440c
Author: Bob Melander <email address hidden>
Date: Wed Dec 20 13:16:27 2017 +0100

    Make ASR1k L3 router plugin compatible with stable/pike.

    A number of changes were made to neutron during pike cycle that
    impacted the ASR1k L3 plugin:

    - The way the notify callback was unsubscribed did not work with
      pike release as the callback function has been moved in neutron.
    - How DB model hooks for queries and filtering are done also changed
      so the ASR1k L3 DB hooks were no longer working.
    - Constants for the provider net extension were moved to neutron-lib.
    - DB model for L3 agent binding was moved in neutron.

    This patch fixes those issues.

    Closes-bug: #1737004

    Change-Id: I556e2ec6ea562ce1949db5dc0abb7b7ec3aa73b6

Changed in networking-cisco:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.