I am also seeing something similar with master branch:
I know rabbit is working correclty becuase other services don't have a problem.
2015-10-22 22:10:42.636 DEBUG oslo_messaging._drivers.amqpdriver [-] MSG_ID is 351b422c33fd42ffb67326c061d36787 from (pid=5522) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:392
2015-10-22 22:11:42.640 ERROR neutron_lbaas.agent.agent_manager [-] Unable to retrieve ready devices
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager Traceback (most recent call last):
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/opt/stack/neutron-lbaas/neutron_lbaas/agent/agent_manager.py", line 151, in sync_state
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager ready_instances = set(self.plugin_rpc.get_ready_devices())
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/opt/stack/neutron-lbaas/neutron_lbaas/agent/agent_api.py", line 34, in get_ready_devices
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager return cctxt.call(self.context, 'get_ready_devices', host=self.host)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager retry=self.retry)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager timeout=timeout, retry=retry)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager retry=retry)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager result = self._waiter.wait(msg_id, timeout)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager message = self.waiters.get(msg_id, timeout=timeout)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager 'to message ID %s' % msg_id)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager MessagingTimeout: Timed out waiting for a reply to message ID 351b422c33fd42ffb67326c061d36787
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager
2015-10-22 22:11:42.641 WARNING oslo.service.loopingcall [-] Function 'neutron_lbaas.agent.agent_manager.LbaasAgentManager.run_periodic_tasks' run outlasted interval by 50.01 sec
2015-10-22 22:11:42.641 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5522) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
Here is my local.conf
[[local|localrc]]
GIT_BASE=https://git.openstack.org
HOST_IP=192.168.214.178
DATA_IP=192.168.214.178
SERVICE_HOST=192.168.214.178
#OFFLINE=True
Q_USE_DEBUG_COMMAND=True
#Q_DVR_MODE=dvr_snat
#USE_SCREEN=False
#NEUTRON_CREATE_INITIAL_NETWORKS=False
DEST=/opt/stack
# move DATA_DIR outside of DEST to keep DEST a bit cleaner
DATA_DIR=/opt/stack/data
ACTIVE_TIMEOUT=90
BOOT_TIMEOUT=90
ASSOCIATE_TIMEOUT=60
TERMINATE_TIMEOUT=60
# Old log files are automatically removed after 7 days to keep things neat. Change
# the number of days by setting ``LOGDAYS``.
LOGDAYS=2
# Swift
# -----
# Swift is now used as the back-end for the S3-like object store. If Nova's
# objectstore (``n-obj`` in ``ENABLED_SERVICES``) is enabled, it will NOT
# run if Swift is enabled. Setting the hash value is required and you will
# be prompted for it if Swift is enabled so just set it to something already:
SWIFT_HASH=66a3d6b56c1f479c8b4e70ab5c2000f5
# For development purposes the default of 3 replicas is usually not required.
# Set this to 1 to save some resources:
SWIFT_REPLICAS=1
# The data for Swift is stored by default in (``$DEST/data/swift``),
# or (``$DATA_DIR/swift``) if ``DATA_DIR`` has been set, and can be
# moved by setting ``SWIFT_DATA_DIR``. The directory will be created
# if it does not exist.
SWIFT_DATA_DIR=$DEST/data
I am also seeing something similar with master branch:
I know rabbit is working correclty becuase other services don't have a problem.
2015-10-22 22:10:42.636 DEBUG oslo_messaging. _drivers. amqpdriver [-] MSG_ID is 351b422c33fd42f fb67326c061d367 87 from (pid=5522) _send /usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ _drivers/ amqpdriver. py:392 lbaas.agent. agent_manager [-] Unable to retrieve ready devices lbaas.agent. agent_manager Traceback (most recent call last): lbaas.agent. agent_manager File "/opt/stack/ neutron- lbaas/neutron_ lbaas/agent/ agent_manager. py", line 151, in sync_state lbaas.agent. agent_manager ready_instances = set(self. plugin_ rpc.get_ ready_devices( )) lbaas.agent. agent_manager File "/opt/stack/ neutron- lbaas/neutron_ lbaas/agent/ agent_api. py", line 34, in get_ready_devices lbaas.agent. agent_manager return cctxt.call( self.context, 'get_ready_ devices' , host=self.host) lbaas.agent. agent_manager File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ rpc/client. py", line 158, in call lbaas.agent. agent_manager retry=self.retry) lbaas.agent. agent_manager File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ transport. py", line 90, in _send lbaas.agent. agent_manager timeout=timeout, retry=retry) lbaas.agent. agent_manager File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ _drivers/ amqpdriver. py", line 431, in send lbaas.agent. agent_manager retry=retry) lbaas.agent. agent_manager File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ _drivers/ amqpdriver. py", line 420, in _send lbaas.agent. agent_manager result = self._waiter. wait(msg_ id, timeout) lbaas.agent. agent_manager File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ _drivers/ amqpdriver. py", line 318, in wait lbaas.agent. agent_manager message = self.waiters. get(msg_ id, timeout=timeout) lbaas.agent. agent_manager File "/usr/local/ lib/python2. 7/dist- packages/ oslo_messaging/ _drivers/ amqpdriver. py", line 223, in get lbaas.agent. agent_manager 'to message ID %s' % msg_id) lbaas.agent. agent_manager MessagingTimeout: Timed out waiting for a reply to message ID 351b422c33fd42f fb67326c061d367 87 lbaas.agent. agent_manager loopingcall [-] Function 'neutron_ lbaas.agent. agent_manager. LbaasAgentManag er.run_ periodic_ tasks' run outlasted interval by 50.01 sec periodic_ task [-] Running periodic task LbaasAgentManag er.collect_ stats from (pid=5522) run_periodic_tasks /usr/local/ lib/python2. 7/dist- packages/ oslo_service/ periodic_ task.py: 213
2015-10-22 22:11:42.640 ERROR neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.640 TRACE neutron_
2015-10-22 22:11:42.641 WARNING oslo.service.
2015-10-22 22:11:42.641 DEBUG oslo_service.
Here is my local.conf /git.openstack. org 192.168. 214.178 192.168. 214.178 HOST=192. 168.214. 178 COMMAND= True MODE=dvr_ snat CREATE_ INITIAL_ NETWORKS= False /opt/stack/ data TIMEOUT= 60 TIMEOUT= 60
[[local|localrc]]
GIT_BASE=https:/
HOST_IP=
DATA_IP=
SERVICE_
#OFFLINE=True
Q_USE_DEBUG_
#Q_DVR_
#USE_SCREEN=False
#NEUTRON_
DEST=/opt/stack
# move DATA_DIR outside of DEST to keep DEST a bit cleaner
DATA_DIR=
ACTIVE_TIMEOUT=90
BOOT_TIMEOUT=90
ASSOCIATE_
TERMINATE_
ADMIN_PASSWORD= password password PASSWORD= password PASSWORD= password TOKEN=password
MYSQL_PASSWORD=
RABBIT_
SERVICE_
SERVICE_
DATABASE_ PASSWORD= password
enable_plugin neutron-lbaas https:/ /git.openstack. org/openstack/ neutron- lbaas /git.openstack. org/openstack/ octavia
enable_plugin octavia https:/
LIBS_FROM_ GIT+=python- neutronclient $DEST/logs/ stack.sh. log LOGDIR= $DEST/logs
# Enable Logging
LOGFILE=
VERBOSE=True
LOG_COLOR=True
SCREEN_
# Pre-requisites
enable_service rabbit
enable_service mysql
enable_service key
# Horizon
enable_service horizon
# Nova
enable_service n-api
enable_service n-crt
enable_service n-obj
enable_service n-cpu
enable_service n-cond
enable_service n-sch
# Glance
enable_service g-api
enable_service g-reg
# Neutron
enable_service q-svc
enable_service q-agt
enable_service q-dhcp
enable_service q-l3
enable_service q-meta
# Cinder
enable_service c-api
enable_service c-vol
enable_service c-sch
# LBaaS V2 and Octavia
enable_service q-lbaasv2
enable_service octavia
enable_service o-cw
enable_service o-hm
enable_service o-hk
enable_service o-api
# enable DVR
Q_PLUGIN=ml2 NETWORK_ TYPE=vxlan MODE=dvr_ snat
Q_ML2_TENANT_
#Q_DVR_
IMAGE_URLS+=",http:// download. cirros- cloud.net/ 0.3.4/cirros- 0.3.4-x86_ 64-disk. img"
LOGFILE= $DEST/logs/ stack.sh. log
# Old log files are automatically removed after 7 days to keep things neat. Change
# the number of days by setting ``LOGDAYS``.
LOGDAYS=2
# Swift
# -----
# Swift is now used as the back-end for the S3-like object store. If Nova's SERVICES` `) is enabled, it will NOT 66a3d6b56c1f479 c8b4e70ab5c2000 f5
# objectstore (``n-obj`` in ``ENABLED_
# run if Swift is enabled. Setting the hash value is required and you will
# be prompted for it if Swift is enabled so just set it to something already:
SWIFT_HASH=
# For development purposes the default of 3 replicas is usually not required.
# Set this to 1 to save some resources:
SWIFT_REPLICAS=1
# The data for Swift is stored by default in (``$DEST/ data/swift` `), DIR/swift` `) if ``DATA_DIR`` has been set, and can be DIR=$DEST/ data
# or (``$DATA_
# moved by setting ``SWIFT_DATA_DIR``. The directory will be created
# if it does not exist.
SWIFT_DATA_