Comment 43 for bug 1338732

Revision history for this message
JohnsonYi (yichengli) wrote :

Hello Chris J Arges, I tested your package https://launchpad.net/ubuntu/+source/oslo.messaging/1.4.1-0ubuntu1.1 on my fuel openstack environment, it didn't work very well.

Please check the below information for details,

[root@mvp-builder ~]# fuel --f
api: '1.0'
astute_sha: 16b252d93be6aaa73030b8100cf8c5ca6a970a91
auth_required: true
build_id: 2014-12-26_14-25-46
build_number: '58'
feature_groups:
- mirantis
- experimental
fuellib_sha: fde8ba5e11a1acaf819d402c645c731af450aff0
fuelmain_sha: 81d38d6f2903b5a8b4bee79ca45a54b76c1361b8
nailgun_sha: 5f91157daa6798ff522ca9f6d34e7e135f150a90
ostf_sha: a9afb68710d809570460c29d6c3293219d3624d4
production: docker
release: '6.0'
release_versions:
  2014.2-6.0:
    VERSION:
      api: '1.0'
      astute_sha: 16b252d93be6aaa73030b8100cf8c5ca6a970a91
      build_id: 2014-12-26_14-25-46
      build_number: '58'
      feature_groups:
      - mirantis
      fuellib_sha: fde8ba5e11a1acaf819d402c645c731af450aff0
      fuelmain_sha: 81d38d6f2903b5a8b4bee79ca45a54b76c1361b8
      nailgun_sha: 5f91157daa6798ff522ca9f6d34e7e135f150a90
      ostf_sha: a9afb68710d809570460c29d6c3293219d3624d4
      production: docker
      release: '6.0'

root@node-3:~# dpkg -l | grep oslo
ii python-oslo.config 1:1.4.0-fuel6.0~mira16 Common code for Openstack Projects (configuration API)
ii python-oslo.db 1.0.1-fuel6.0~mira19 oslo db library
ii python-oslo.i18n 1.0.0-fuel6.0~mira16 Oslo Internationalization Utilities - Python 2.x
ii python-oslo.messaging 1.4.1-fuel6.0~mira18 oslo messaging library
ii python-oslo.rootwrap 1.3.0.0a1-ubuntu2 Fine filtering of shell commands as 'root'
ii python-oslo.serialization 1.0.0-fuel6.0~mira15 utilities for serialization , especially JSON - Python 2.x
ii python-oslo.utils 1.0.0-fuel6.0~mira16 set of utility functions for OpenStack - Python 2.x
ii python-oslo.vmware 0.6.0-fuel6.0~mira16 VMware library for OpenStack projects - Python 2.x

I replaced the whole folder under oslo.messaging-1.4.1\oslo\messaging to /usr/share/pyshared/oslo/messaging, then restart all 3 controllers, the HA didn't work very well, nova service-list did not work with HTTP 503 error. Neutron components didn't work very well also.

Please check below error messages,
<166>Jul 16 14:22:12 node-3 neutron-server 2015-07-16 14:22:12.436 6138 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 127.0.0.1:5673
<166>Jul 16 14:22:12 node-3 neutron-server 2015-07-16 14:22:12.456 6138 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 127.0.0.1:5673
<163>Jul 16 14:22:12 node-3 neutron-server 2015-07-16 14:22:12.544 6061 ERROR oslo.messaging._drivers.impl_rabbit [-] Failed to publish message to topic 'reply_c2d631eb2efa4fc1b88d2d03f90d6bca': [Errno 32] Broken pipe
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit Traceback (most recent call last):
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/impl_rabbit.py", line 681, in ensure
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit return method()
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/impl_rabbit.py", line 784, in _publish
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/impl_rabbit.py", line 377, in __init__
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit type='direct', **options)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/impl_rabbit.py", line 340, in __init__
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit self.reconnect(channel)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/impl_rabbit.py", line 348, in reconnect
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit routing_key=self.routing_key)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 84, in __init__
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit self.revive(self._channel)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 218, in revive
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit self.declare()
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 104, in declare
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit self.exchange.declare()
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/kombu/entity.py", line 166, in declare
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit nowait=nowait, passive=passive,
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/channel.py", line 613, in exchange_declare
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit self._send_method((40, 10), args)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 56, in _send_method
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit self.channel_id, method_sig, args, content,
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/method_framing.py", line 221, in write_method
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit write_frame(1, channel, payload)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/amqp/transport.py", line 177, in write_frame
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit frame_type, channel, size, payload, 0xce,
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 357, in sendall
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit tail = self.send(data, flags)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 340, in send
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit total_sent += fd.send(data[total_sent:], flags)
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit error: [Errno 32] Broken pipe
2015-07-16 14:22:12.544 6061 TRACE oslo.messaging._drivers.impl_rabbit
<166>Jul 16 14:22:12 node-3 neutron-server 2015-07-16 14:22:12.549 6061 INFO oslo.messaging._drivers.impl_rabbit [-] Delaying reconnect for 5.0 seconds ...
<166>Jul 16 14:22:17 node-3 neutron-server 2015-07-16 14:22:17.549 6061 INFO oslo.messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 10.14.68.7:5673
<166>Jul 16 14:22:17 node-3 neutron-server 2015-07-16 14:22:17.566 6061 INFO oslo.messaging._drivers.impl_rabbit [-] Connected to AMQP server on 10.14.68.7:5673

Thanks.