Juniper Openstack

R3.1 mitaka build 6: nova-compute dead due to amqp connection error

Bug #1607179 reported by sundarkh
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
New
High
Dheeraj Gautam
R3.1
New
High
Dheeraj Gautam
Juniper Openstack r3.1.0.0-fcs

Bug Description

R3.1 mitaka build 6: nova-compute dead due to amqp connection error

Target is brought up by ServerManager

== Nova services ==
openstack-nova-api: active
openstack-nova-compute: dead
openstack-nova-network: inactive (disabled on boot)
openstack-nova-scheduler: active
openstack-nova-volume: inactive (disabled on boot)
openstack-nova-conductor: active

2016-07-27 12:23:58.117 7751 CRITICAL nova [req-3a7d0def-6a99-42fa-81c9-874ffeb7a429 - - - - -] AccessRefused: (0, 0): (403) ACCESS_REFUSED - Login was refused using authentication mechanism AMQPLAIN. For details see the broker logfile.
2016-07-27 12:23:58.117 7751 ERROR nova Traceback (most recent call last):
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/bin/nova-compute", line 10, in <module>
2016-07-27 12:23:58.117 7751 ERROR nova sys.exit(main())
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/nova/cmd/compute.py", line 74, in main
2016-07-27 12:23:58.117 7751 ERROR nova db_allowed=CONF.conductor.use_local)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/nova/service.py", line 296, in create
2016-07-27 12:23:58.117 7751 ERROR nova db_allowed=db_allowed)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/nova/service.py", line 191, in __init__
2016-07-27 12:23:58.117 7751 ERROR nova self.conductor_api.wait_until_ready(context.get_admin_context())
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 157, in wait_until_ready
2016-07-27 12:23:58.117 7751 ERROR nova timeout=timeout)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/nova/baserpc.py", line 62, in ping
2016-07-27 12:23:58.117 7751 ERROR nova return cctxt.call(context, 'ping', arg=arg_p)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-07-27 12:23:58.117 7751 ERROR nova retry=self.retry)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2016-07-27 12:23:58.117 7751 ERROR nova timeout=timeout, retry=retry)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 470, in send
2016-07-27 12:23:58.117 7751 ERROR nova retry=retry)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 414, in _send
2016-07-27 12:23:58.117 7751 ERROR nova msg.update({'_reply_q': self._get_reply_q()})
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 386, in _get_reply_q
2016-07-27 12:23:58.117 7751 ERROR nova conn = self._get_connection(rpc_common.PURPOSE_LISTEN)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 377, in _get_connection
2016-07-27 12:23:58.117 7751 ERROR nova purpose=purpose)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/common.py", line 396, in __init__
2016-07-27 12:23:58.117 7751 ERROR nova self.connection = connection_pool.create(purpose)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/pool.py", line 110, in create
2016-07-27 12:23:58.117 7751 ERROR nova return self.connection_cls(self.conf, self.url, purpose)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 555, in __init__
2016-07-27 12:23:58.117 7751 ERROR nova self.ensure_connection()
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 653, in ensure_connection
2016-07-27 12:23:58.117 7751 ERROR nova self.ensure(method=lambda: self.connection.connection)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 758, in ensure
2016-07-27 12:23:58.117 7751 ERROR nova ret, channel = autoretry_method()
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 436, in _ensured
2016-07-27 12:23:58.117 7751 ERROR nova return fun(*args, **kwargs)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 507, in __call__
2016-07-27 12:23:58.117 7751 ERROR nova self.revive(create_channel())
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 242, in channel
2016-07-27 12:23:58.117 7751 ERROR nova chan = self.transport.create_channel(self.connection)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 741, in connection
2016-07-27 12:23:58.117 7751 ERROR nova self._connection = self._establish_connection()
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 696, in _establish_connection
2016-07-27 12:23:58.117 7751 ERROR nova conn = self.transport.establish_connection()

2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqp.py", line 116, in establish_connection
2016-07-27 12:23:58.117 7751 ERROR nova conn = self.Connection(**opts)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 180, in __init__
2016-07-27 12:23:58.117 7751 ERROR nova (10, 30), # tune
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 67, in wait
2016-07-27 12:23:58.117 7751 ERROR nova self.channel_id, allowed_methods, timeout)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 274, in _wait_method
2016-07-27 12:23:58.117 7751 ERROR nova wait()
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 69, in wait
2016-07-27 12:23:58.117 7751 ERROR nova return self.dispatch_method(method_sig, args, content)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 87, in dispatch_method
2016-07-27 12:23:58.117 7751 ERROR nova return amqp_method(self, args)
2016-07-27 12:23:58.117 7751 ERROR nova File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 530, in _close
2016-07-27 12:23:58.117 7751 ERROR nova (class_id, method_id), ConnectionError)
2016-07-27 12:23:58.117 7751 ERROR nova AccessRefused: (0, 0): (403) ACCESS_REFUSED - Login was refused using authentication mechanism AMQPLAIN. For details see the broker logfile.
2016-07-27 12:23:58.117 7751 ERROR nova

Sudheendra Rao (sudheendra-k)
Changed in juniperopenstack:
milestone: r3.1.0.0-fcs → none
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.