unable to start novajoin-notifier in containerized undercloud

Bug #1784851 reported by Juan Antonio Osorio Robles
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Juan Antonio Osorio Robles

Bug Description

2018-08-01 12:48:17.220 6 CRITICAL join [-] Unhandled error: MessageDeliveryFailure: Unable to connect to AMQP server on undercloud.internalapi.walrusdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED - Login was refused using authentication mechanism AMQPLAIN. For details see the broker logfile.
2018-08-01 12:48:17.220 6 ERROR join Traceback (most recent call last):
2018-08-01 12:48:17.220 6 ERROR join File "/usr/bin/novajoin-notify", line 10, in <module>
2018-08-01 12:48:17.220 6 ERROR join sys.exit(main())
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/novajoin/notifications.py", line 282, in main
2018-08-01 12:48:17.220 6 ERROR join server.start()
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
2018-08-01 12:48:17.220 6 ERROR join log_after, timeout_timer)
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
2018-08-01 12:48:17.220 6 ERROR join post_fn = fn()
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
2018-08-01 12:48:17.220 6 ERROR join states[state].run_once(lambda: fn(self, *args, **kwargs),
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
2018-08-01 12:48:17.220 6 ERROR join self.listener = self._create_listener()
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/notify/listener.py", line 160, in _create_listener
2018-08-01 12:48:17.220 6 ERROR join self._batch_timeout
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 158, in _listen_for_notifications
2018-08-01 12:48:17.220 6 ERROR join targets_and_priorities, pool, batch_size, batch_timeout
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 609, in listen_for_notifications
2018-08-01 12:48:17.220 6 ERROR join conn = self._get_connection(rpc_common.PURPOSE_LISTEN)
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 498, in _get_connection
2018-08-01 12:48:17.220 6 ERROR join purpose=purpose)
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/common.py", line 407, in __init__
2018-08-01 12:48:17.220 6 ERROR join self.connection = connection_pool.create(purpose)
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/pool.py", line 144, in create
2018-08-01 12:48:17.220 6 ERROR join return self.connection_cls(self.conf, self.url, purpose)
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 601, in __init__
2018-08-01 12:48:17.220 6 ERROR join self.ensure_connection()
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 700, in ensure_connection
2018-08-01 12:48:17.220 6 ERROR join self.ensure(method=self.connection.connect)
2018-08-01 12:48:17.220 6 ERROR join File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 811, in ensure
2018-08-01 12:48:17.220 6 ERROR join raise exceptions.MessageDeliveryFailure(msg)
2018-08-01 12:48:17.220 6 ERROR join MessageDeliveryFailure: Unable to connect to AMQP server on undercloud.internalapi.walrusdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED - Login was refused using authentication mechanism AMQPLAIN. For details see the broker logfile.

Changed in tripleo:
status: New → Triaged
importance: Undecided → High
milestone: none → rocky-rc1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (master)

Fix proposed to branch: master
Review: https://review.openstack.org/587817

Changed in tripleo:
assignee: nobody → Juan Antonio Osorio Robles (juan-osorio-robles)
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (master)

Reviewed: https://review.openstack.org/587817
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=2c88645ec6a32a0fdc91da40bab63f855bf942d3
Submitter: Zuul
Branch: master

commit 2c88645ec6a32a0fdc91da40bab63f855bf942d3
Author: Juan Antonio Osorio Robles <email address hidden>
Date: Wed Aug 1 16:09:00 2018 +0300

    Use RPCPassword instead of RabbitPassword for novajoin

    RabbitPassword is no longer in use and was causing issues.

    Change-Id: I82eb39b1184958bf834dc8726a6ec0c4b9d44846
    Closes-Bug: #1784851

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 9.0.0.0rc1

This issue was fixed in the openstack/tripleo-heat-templates 9.0.0.0rc1 release candidate.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.