Fuel for OpenStack

haproxy restart loop due to too short timeout

Bug #1464650 reported by Eric Jacobs
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Sergii Golovatiuk
Fuel for OpenStack 6.1
6.1.x
Fix Committed
Critical
Eric Jacobs
Fuel for OpenStack 6.1
7.0.x
Fix Released
Critical
Eric Jacobs
Fuel for OpenStack 7.0

Bug Description

The timeout for p_haproxy-start is 30 seconds. In situations where haproxy takes more than 30 seconds to start, the following loop occurs:

1. haproxy starts to come up; binds vips and ports
2. traffic starts to flow on the vips
3. haproxy gets killed; vips go down
4. goto 1

This can cause deployment to fail during secondary controller setup, and causes major difficult to diagnose problems for the entire environment.

Recommended fix: increase timeout to 45 or 60 seconds.

Tags: scale 6.1rc2
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/191038

Changed in fuel:
assignee: nobody → Eric Jacobs (ejacobs)
status: New → In Progress
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

Added the scale tag is this issue may be as well applicable for heavy loaded environments

Changed in fuel:
importance: Undecided → Critical
milestone: none → 6.1
tags: added: scale
Changed in fuel:
status: In Progress → Triaged
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/6.1)

Fix proposed to branch: stable/6.1
Review: https://review.openstack.org/191182

Nastya Urlapova (aurlapova)
tags: added: 6.1rc2
Bogdan Dobrelya (bogdando)
Changed in fuel:
status: Triaged → In Progress
assignee: Eric Jacobs (ejacobs) → Sergii Golovatiuk (sgolovatiuk)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/191038
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=50f32ebb0d0ab4f22875c7ac509199377d673d99
Submitter: Jenkins
Branch: master

commit 50f32ebb0d0ab4f22875c7ac509199377d673d99
Author: Eric Jacobs <email address hidden>
Date: Fri Jun 12 08:30:30 2015 -0400

    increase haproxy-start timeout to 60 seconds

    Changed haproxy start timeout to 60 seconds, from 30 seconds in
    haproxy_ocf.pp.

    Change-Id: Idf9692954074fb953a3ff11761d1444288a3e24e
    Closes-Bug: #1464650

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/6.1)

Reviewed: https://review.openstack.org/191182
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=6717dcccb507aab4dc71b7d9b8cf14a8c9ac155e
Submitter: Jenkins
Branch: stable/6.1

commit 6717dcccb507aab4dc71b7d9b8cf14a8c9ac155e
Author: Eric Jacobs <email address hidden>
Date: Fri Jun 12 08:30:30 2015 -0400

    increase haproxy-start timeout to 60 seconds

    Changed haproxy start timeout to 60 seconds, from 30 seconds in
    haproxy_ocf.pp.

    Change-Id: Idf9692954074fb953a3ff11761d1444288a3e24e
    Closes-Bug: #1464650

Revision history for this message
Nastya Urlapova (aurlapova) wrote :

Issue is not reproduce approximately two month, moved to Fix Released.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.