MariaDB not accepting connections straight away

Bug #1840145 reported by Scott Solkhon
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Medium
Scott Solkhon
Train
Fix Released
Medium
Scott Solkhon

Bug Description

When running a deploy task sometimes MariaDB can reject connections even when all database services are up,
possibly due to the health check polling in HAProxy.

First noticed when running a deployment and having XtraBackup enabled. The task times out and then once you run Kolla-Ansible again it deploys successfully.

Changed in kolla-ansible:
status: New → In Progress
assignee: nobody → Scott Solkhon (scott.solkhon)
Mark Goddard (mgoddard)
Changed in kolla-ansible:
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/676219
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=03cd7eb3563788ca1ffd7b19130f18614887a546
Submitter: Zuul
Branch: master

commit 03cd7eb3563788ca1ffd7b19130f18614887a546
Author: Scott Solkhon <email address hidden>
Date: Tue Aug 13 15:27:50 2019 +0000

    Wait for MariaDB to be accessible via HAProxy

    Explicitly wait for the database to be accessible via the load balancer.
    Sometimes it can reject connections even when all database services are up,
    possibly due to the health check polling in HAProxy.

    Closes-Bug: #1840145
    Change-Id: I7601bb710097a78f6b29bc4018c71f2c6283eef2

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/693014

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/stein)

Reviewed: https://review.opendev.org/693014
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=0d03d2e28f1d37b3eb21386bd6b1a9665d560b4b
Submitter: Zuul
Branch: stable/stein

commit 0d03d2e28f1d37b3eb21386bd6b1a9665d560b4b
Author: Scott Solkhon <email address hidden>
Date: Tue Aug 13 15:27:50 2019 +0000

    Wait for MariaDB to be accessible via HAProxy

    Explicitly wait for the database to be accessible via the load balancer.
    Sometimes it can reject connections even when all database services are up,
    possibly due to the health check polling in HAProxy.

    Closes-Bug: #1840145
    Change-Id: I7601bb710097a78f6b29bc4018c71f2c6283eef2
    (cherry picked from commit 03cd7eb3563788ca1ffd7b19130f18614887a546)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 9.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 9.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 8.1.0

This issue was fixed in the openstack/kolla-ansible 8.1.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/713500

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/rocky)

Reviewed: https://review.opendev.org/713500
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=b37cb79f6ce2e9017fa21c315bd0fdcec72ee5c9
Submitter: Zuul
Branch: stable/rocky

commit b37cb79f6ce2e9017fa21c315bd0fdcec72ee5c9
Author: Scott Solkhon <email address hidden>
Date: Tue Aug 13 15:27:50 2019 +0000

    Wait for MariaDB to be accessible via HAProxy

    Explicitly wait for the database to be accessible via the load balancer.
    Sometimes it can reject connections even when all database services are up,
    possibly due to the health check polling in HAProxy.

    Closes-Bug: #1840145
    Change-Id: I7601bb710097a78f6b29bc4018c71f2c6283eef2
    (cherry picked from commit 03cd7eb3563788ca1ffd7b19130f18614887a546)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 7.2.1

This issue was fixed in the openstack/kolla-ansible 7.2.1 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.