Comment 2 for bug 1506027

Revision history for this message
Adolfo Duarte (adolfo-duarte) wrote :

I am also seeing something similar with master branch:
I know rabbit is working correclty becuase other services don't have a problem.

2015-10-22 22:10:42.636 DEBUG oslo_messaging._drivers.amqpdriver [-] MSG_ID is 351b422c33fd42ffb67326c061d36787 from (pid=5522) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:392
2015-10-22 22:11:42.640 ERROR neutron_lbaas.agent.agent_manager [-] Unable to retrieve ready devices
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager Traceback (most recent call last):
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/opt/stack/neutron-lbaas/neutron_lbaas/agent/agent_manager.py", line 151, in sync_state
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager ready_instances = set(self.plugin_rpc.get_ready_devices())
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/opt/stack/neutron-lbaas/neutron_lbaas/agent/agent_api.py", line 34, in get_ready_devices
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager return cctxt.call(self.context, 'get_ready_devices', host=self.host)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager retry=self.retry)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager timeout=timeout, retry=retry)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 431, in send
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager retry=retry)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 420, in _send
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager result = self._waiter.wait(msg_id, timeout)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 318, in wait
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager message = self.waiters.get(msg_id, timeout=timeout)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 223, in get
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager 'to message ID %s' % msg_id)
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager MessagingTimeout: Timed out waiting for a reply to message ID 351b422c33fd42ffb67326c061d36787
2015-10-22 22:11:42.640 TRACE neutron_lbaas.agent.agent_manager
2015-10-22 22:11:42.641 WARNING oslo.service.loopingcall [-] Function 'neutron_lbaas.agent.agent_manager.LbaasAgentManager.run_periodic_tasks' run outlasted interval by 50.01 sec
2015-10-22 22:11:42.641 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5522) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213

Here is my local.conf
[[local|localrc]]
GIT_BASE=https://git.openstack.org
HOST_IP=192.168.214.178
DATA_IP=192.168.214.178
SERVICE_HOST=192.168.214.178
#OFFLINE=True
Q_USE_DEBUG_COMMAND=True
#Q_DVR_MODE=dvr_snat
#USE_SCREEN=False
#NEUTRON_CREATE_INITIAL_NETWORKS=False
DEST=/opt/stack
# move DATA_DIR outside of DEST to keep DEST a bit cleaner
DATA_DIR=/opt/stack/data
ACTIVE_TIMEOUT=90
BOOT_TIMEOUT=90
ASSOCIATE_TIMEOUT=60
TERMINATE_TIMEOUT=60

ADMIN_PASSWORD=password
MYSQL_PASSWORD=password
RABBIT_PASSWORD=password
SERVICE_PASSWORD=password
SERVICE_TOKEN=password

DATABASE_PASSWORD=password

enable_plugin neutron-lbaas https://git.openstack.org/openstack/neutron-lbaas
enable_plugin octavia https://git.openstack.org/openstack/octavia

LIBS_FROM_GIT+=python-neutronclient
# Enable Logging
LOGFILE=$DEST/logs/stack.sh.log
VERBOSE=True
LOG_COLOR=True
SCREEN_LOGDIR=$DEST/logs

# Pre-requisites
enable_service rabbit
enable_service mysql
enable_service key

# Horizon
enable_service horizon

# Nova
enable_service n-api
enable_service n-crt
enable_service n-obj
enable_service n-cpu
enable_service n-cond
enable_service n-sch

# Glance
enable_service g-api
enable_service g-reg

# Neutron
enable_service q-svc
enable_service q-agt
enable_service q-dhcp
enable_service q-l3
enable_service q-meta

# Cinder
enable_service c-api
enable_service c-vol
enable_service c-sch

# LBaaS V2 and Octavia
enable_service q-lbaasv2
enable_service octavia
enable_service o-cw
enable_service o-hm
enable_service o-hk
enable_service o-api

# enable DVR

Q_PLUGIN=ml2
Q_ML2_TENANT_NETWORK_TYPE=vxlan
#Q_DVR_MODE=dvr_snat

IMAGE_URLS+=",http://download.cirros-cloud.net/0.3.4/cirros-0.3.4-x86_64-disk.img"

LOGFILE=$DEST/logs/stack.sh.log

# Old log files are automatically removed after 7 days to keep things neat. Change
# the number of days by setting ``LOGDAYS``.
LOGDAYS=2

# Swift
# -----

# Swift is now used as the back-end for the S3-like object store. If Nova's
# objectstore (``n-obj`` in ``ENABLED_SERVICES``) is enabled, it will NOT
# run if Swift is enabled. Setting the hash value is required and you will
# be prompted for it if Swift is enabled so just set it to something already:
SWIFT_HASH=66a3d6b56c1f479c8b4e70ab5c2000f5

# For development purposes the default of 3 replicas is usually not required.
# Set this to 1 to save some resources:
SWIFT_REPLICAS=1

# The data for Swift is stored by default in (``$DEST/data/swift``),
# or (``$DATA_DIR/swift``) if ``DATA_DIR`` has been set, and can be
# moved by setting ``SWIFT_DATA_DIR``. The directory will be created
# if it does not exist.
SWIFT_DATA_DIR=$DEST/data