RecoverableConnectionError: connection already closed

[jazeltq]

We met the error in agent-notification.log

12.30:5672 via [amqp] clientwith port 43696.
2017-10-19 17:09:42.607 615927 ERROR root [-] Unexpected exception occurred 24 time(s)... retrying.
2017-10-19 17:09:42.607 615927 ERROR root Traceback (most recent call last):
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 250, in wrapper
2017-10-19 17:09:42.607 615927 ERROR root return infunc(*args, **kwargs)
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/base.py", line 203, in _runner
2017-10-19 17:09:42.607 615927 ERROR root batch_size=self.batch_size, batch_timeout=self.batch_timeout)
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/base.py", line 52, in wrapper
2017-10-19 17:09:42.607 615927 ERROR root msg = func(in_self, timeout=timeout_watch.leftover(True))
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 286, in poll
2017-10-19 17:09:42.607 615927 ERROR root self._message_operations_handler.process()
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 89, in process
2017-10-19 17:09:42.607 615927 ERROR root task()
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 251, in acknowledge
2017-10-19 17:09:42.607 615927 ERROR root self._raw_message.ack()
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/kombu/message.py", line 88, in ack
2017-10-19 17:09:42.607 615927 ERROR root self.channel.basic_ack(self.delivery_tag)
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/amqp/channel.py", line 1583, in basic_ack
2017-10-19 17:09:42.607 615927 ERROR root self._send_method((60, 80), args)
2017-10-19 17:09:42.607 615927 ERROR root File "/usr/lib/python2.7/site-packages/amqp/abstract_channel.py", line 50, in _send_method
2017-10-19 17:09:42.607 615927 ERROR root raise RecoverableConnectionError('connection already closed')
2017-10-19 17:09:42.607 615927 ERROR root RecoverableConnectionError: connection already closed
2017-10-19 17:09:42.607 615927 ERROR root

the oslo.messaging is
[root@controller-1-jxq-pod1-rack4 ceilometer]# rpm -qa | grep oslo.messag
python2-oslo-messaging-5.10.2-1.el7.noarch

the ceilometer agent notification is newton. It use threading as the executor for listener.

[Ken Giusti (kgiusti)]

I believe the fix for https://review.openstack.org/#/c/577912/
will prevent this bug.

I'm marking this duplicate of https://bugs.launchpad.net/oslo.messaging/+bug/1695746 for now.

We can re-open this should the fix not address the problem.