Comment 1 for bug 1412961

Revision history for this message
Patrick Crews (patrick-crews) wrote : Re: heat snapshot and restore operations causing significant memory consumption

the engine logs have a large number of these messages:
/usr/lib/python2.7/dist-packages/amqp/channel.py:608: DeprecationWarning: auto_delete exchanges has been deprecated
  'auto_delete exchanges has been deprecated'))

2015-01-20 09:43:21.418 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 192.168.0.5:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.
2015-01-20 09:43:21.419 ERROR oslo.messaging._drivers.impl_rabbit [-] Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit Traceback (most recent call last):
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 440, in _ensured
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit return fun(*args, **kwargs)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 512, in __call__
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit return fun(*args, channel=channels[0], **kwargs), channels[0]
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/_drivers/impl_rabbit.py", line 695, in _consume
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit return self.connection.drain_events(timeout=1)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 279, in drain_events
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit return self.transport.drain_events(self.connection, **kwargs)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqp.py", line 90, in drain_events
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit return connection.drain_events(**kwargs)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 303, in drain_events
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit return amqp_method(channel, args)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 506, in _close
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit self._x_close_ok()
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 534, in _x_close_ok
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit self._send_method((10, 51))
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 62, in _send_method
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit self.channel_id, method_sig, args, content,
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/method_framing.py", line 227, in write_method
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit write_frame(1, channel, payload)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/transport.py", line 183, in write_frame
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit frame_type, channel, size, payload, 0xce,
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/local/lib/python2.7/dist-packages/eventlet/greenio.py", line 359, in sendall
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit tail = self.send(data, flags)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/local/lib/python2.7/dist-packages/eventlet/greenio.py", line 342, in send
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit total_sent += fd.send(data[total_sent:], flags)
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit error: [Errno 104] Connection reset by peer
2015-01-20 09:43:21.419 TRACE oslo.messaging._drivers.impl_rabbit