apache2 can be start of sysv script before o-r-c configures it blocking the o-r-c run

Bug #1352924 reported by Michael Kerrin
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
High
Nicholas Randon

Bug Description

If apache2 gets started by sysv script before o-r-c configures it to listen only on certain port then apache2 will block haproxy element from configuring haproxy and those blocking o-r-c from configuring and restarting apache2.

We will need to enable apache2 after configuring it. So apache2 should not come up till we are ready.

This is a race we caught in our internal CI but with certain changes coming to the heat templates to add more dependency control we will probable see more of this.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-image-elements (master)

Fix proposed to branch: master
Review: https://review.openstack.org/112039

Changed in tripleo:
assignee: nobody → Michael Kerrin (michael-kerrin-w)
status: New → In Progress
Ben Nemec (bnemec)
Changed in tripleo:
importance: Undecided → High
Revision history for this message
Michael Kerrin (michael-kerrin-w) wrote :
Download full text (7.6 KiB)

This is still an issue

From os-collect-config.log on controller0 in the 3 node controller setup

Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: dib-run-parts Fri Nov 7 15:52:57 UTC 2014 Running /opt/stack/os-config-refresh/configure.d/21-haproxy
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: + os-svc-enable -n haproxy
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: System start/stop links for /etc/init.d/haproxy already exist.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: + service haproxy status
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: haproxy is running.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: + service haproxy reload
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: * Reloading haproxy haproxy
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'keystone_admin' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'keystone_public' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'horizon' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'neutron' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'cinder' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'glance_api' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'glance_registry' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'heat_api' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'heat_cloudwatch' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : log format ignored for proxy 'heat_cfn' since it has no log address.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: [WARNING] 310/155257 (27153) : config : missing timeouts for proxy 'mysql'.
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: | While not properly invalid, you will certainly encounter various problems
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-config: | with such a configuration. To fix this, please ensure that all following
Nov 7 15:52:57 overcloud-controller0-uxaia6rkgy4e os-collect-...

Read more...

Changed in tripleo:
assignee: Michael Kerrin (michael-kerrin-w) → Nicholas Randon (nicholas-randon)
Revision history for this message
jiangfei (jiangfei0622) wrote :

How about the progress of this bug? I have encountered this problem.
the same as: https://bugs.launchpad.net/tripleo/+bug/1393643.

may be we can simply stop apache2 before starting haproxy

Revision history for this message
Nicholas Randon (nicholas-randon) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-image-elements (master)

Change abandoned by Michael Kerrin (<email address hidden>) on branch: master
Review: https://review.openstack.org/112039
Reason: Moving on

Ben Nemec (bnemec)
Changed in tripleo:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.