Comment 1 for bug 1352336

The issue is that haproxy reload on machine with VIP fails, then because haproxy is not running keystone is not accessible through VIP. I agree that it looks like a race issue when bringing up keepalive and haproxy services This is relevant part from my log (looks like haproxy reload is done when keepalived setup is not finished yet):

Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 Keepalived_vrrp[7065]: Opening file '/etc/keepalived/keepalived.conf'.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 Keepalived_vrrp[7065]: Configuration is using : 62226 Bytes
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 Keepalived_vrrp[7065]: Using LinkWatch kernel netlink reflector...
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 Keepalived_vrrp[7065]: VRRP sockpool: [ifindex(5), proto(112), unicast(0), fd(10,11)]
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 os-collect-config[780]: Redirecting to /bin/systemctl reload haproxy.service
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 systemd[1]: Reloading HAProxy For TCP And HTTP Based Applications.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'keystone_admin' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'keystone_public' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'horizon' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'neutron' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'cinder' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'glance_api' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'glance_registry' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'heat_api' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'heat_cloudwatch' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'heat_cfn' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'nova_ec2' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'nova_osapi' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'nova_metadata' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'ceilometer' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'swift_proxy_server' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : log format ignored for proxy 'rabbitmq' since it has no log address.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 bash[7075]: [WARNING] 215/184222 (7075) : config : 'stats' statement ignored for proxy 'haproxy.stats' as it requires HTTP mode.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 systemd[1]: Reloaded HAProxy For TCP And HTTP Based Applications.
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 os-collect-config[780]: dib-run-parts Mon Aug 4 18:42:22 UTC 2014 20-haproxy completed
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 os-collect-config[780]: dib-run-parts Mon Aug 4 18:42:22 UTC 2014 Running /opt/stack/os-config-refresh/post-configure.d/40-rabbitmq
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 systemd[1]: haproxy.service: main process exited, code=killed, status=9/KILL
Aug 04 18:42:22 overcloud-controller1-3qnbafdvdgd5 systemd[1]: Unit haproxy.service entered failed state.
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 os-collect-config[780]: + '[' -d /mnt/state/var/log/rabbitmq ']'
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 os-collect-config[780]: + os-svc-enable -n rabbitmq-server
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 systemd[1]: Reloading.
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 os-collect-config[780]: + os-svc-restart -n rabbitmq-server
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 systemd[1]: Stopping RabbitMQ broker...
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 rabbitmqctl[7100]: Stopping and halting node 'rabbit@overcloud-controller1-3qnbafdvdgd5' ...
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 rabbitmqctl[7100]: ...done.
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 systemd[1]: Starting RabbitMQ broker...
Aug 04 18:42:23 overcloud-controller1-3qnbafdvdgd5 Keepalived_vrrp[7065]: VRRP_Instance(VI_1) Transition to MASTER STATE