galera SST can't be configured to use mariabackup

Bug #1973872 reported by Damien Ciabrini
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Medium
Damien Ciabrini

Bug Description

The Galera replication library can be configured to perform full DB synchronization (SST) with either rsync or mariabackup.

Right now in Tripleo, the only method that is exposed is rsync, or rsync supplemented with socat tunnel for TLS-e. But there is no flag exposed to enable the use of mariabackup, or anything to configure such kind of SST in galera.cnf.

Changed in tripleo:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/836190
Committed: https://opendev.org/openstack/tripleo-common/commit/105a0c86276b7a27000707d35c760fc7d51905d0
Submitter: "Zuul (22348)"
Branch: master

commit 105a0c86276b7a27000707d35c760fc7d51905d0
Author: Damien Ciabrini <email address hidden>
Date: Fri Apr 1 16:05:47 2022 +0200

    New dedicated user for Galera SST synchronization

    When the Galera is configured to use mariabackup, the
    synchronization takes place by connecting to the
    database with configuratble user credentials.
    Generate a random password for this use case.

    Related-Bug: #1973872

    Change-Id: I1509bd30fbd253790b17e04ef15dca6c58de7311

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-tripleo (master)

Reviewed: https://review.opendev.org/c/openstack/puppet-tripleo/+/836189
Committed: https://opendev.org/openstack/puppet-tripleo/commit/0d6db2428b2589f458328cc30445a963eeb863ee
Submitter: "Zuul (22348)"
Branch: master

commit 0d6db2428b2589f458328cc30445a963eeb863ee
Author: Damien Ciabrini <email address hidden>
Date: Fri Apr 1 16:23:53 2022 +0200

    Support mariabackup as a galera SST method

    In addition to rsync and rsync tunnelled over socat,
    expose the ability to use mariabackup in galera config.

    Related-Bug: #1973872

    Change-Id: I4d5983ada52a58cdd853bd7b701bb11eeb88be8d

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/836277
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/4cceeebc86b99f76abaf15990e14d85406628be1
Submitter: "Zuul (22348)"
Branch: master

commit 4cceeebc86b99f76abaf15990e14d85406628be1
Author: Damien Ciabrini <email address hidden>
Date: Mon Apr 4 11:02:08 2022 +0200

    Galera: initial support for mariabackup SST

    When deploying a HA overcloud, allow the SST method to be
    configured, to use either rsync (default) or mariabackup.

    Tested by deploying a HA overcloud with mariabackup SST
    (IPv4, IPv6, TLS-e) as well as with regular rsync SST
    (IPv4, IPv6, TLS-e).

    Note that this initial support doesn't allow SST method
    to be updated via a stack update, as mariabackup requires
    a dedicated MySQL user, and there is currently no
    orchestration available via a minor update either.

    Closes-Bug: #1973872
    Depends-On: I1509bd30fbd253790b17e04ef15dca6c58de7311
    Depends-On: I4d5983ada52a58cdd853bd7b701bb11eeb88be8d

    Change-Id: I6b797141800ae7f1773e9a06b232dacd158732f5

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-tripleo (stable/wallaby)

Related fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/puppet-tripleo/+/850035

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (stable/wallaby)

Related fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/tripleo-common/+/850292

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/wallaby)

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/850297

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-tripleo (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/puppet-tripleo/+/850035
Committed: https://opendev.org/openstack/puppet-tripleo/commit/688354081b782a526166d5d1416a104c096a0c21
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 688354081b782a526166d5d1416a104c096a0c21
Author: Damien Ciabrini <email address hidden>
Date: Fri Apr 1 16:23:53 2022 +0200

    Support mariabackup as a galera SST method

    In addition to rsync and rsync tunnelled over socat,
    expose the ability to use mariabackup in galera config.

    Related-Bug: #1973872

    Change-Id: I4d5983ada52a58cdd853bd7b701bb11eeb88be8d
    (cherry picked from commit 0d6db2428b2589f458328cc30445a963eeb863ee)

tags: added: in-stable-wallaby
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/850292
Committed: https://opendev.org/openstack/tripleo-common/commit/a1f50b819bcc9bf078876511de1c9bb2f24d2d05
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit a1f50b819bcc9bf078876511de1c9bb2f24d2d05
Author: Damien Ciabrini <email address hidden>
Date: Fri Apr 1 16:05:47 2022 +0200

    New dedicated user for Galera SST synchronization

    When the Galera is configured to use mariabackup, the
    synchronization takes place by connecting to the
    database with configuratble user credentials.
    Generate a random password for this use case.

    Related-Bug: #1973872

    (Fixed merge conflict manually to prevent backporting
    Ic7ff36a5f3f4eceeb6c8a338093e956b7db00533 with it)

    Change-Id: I1509bd30fbd253790b17e04ef15dca6c58de7311
    (cherry picked from commit 105a0c86276b7a27000707d35c760fc7d51905d0)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/850297
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/24b1fe6ac3771a78832461d0613146583069cc0b
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 24b1fe6ac3771a78832461d0613146583069cc0b
Author: Damien Ciabrini <email address hidden>
Date: Mon Apr 4 11:02:08 2022 +0200

    Galera: initial support for mariabackup SST

    When deploying a HA overcloud, allow the SST method to be
    configured, to use either rsync (default) or mariabackup.

    Tested by deploying a HA overcloud with mariabackup SST
    (IPv4, IPv6, TLS-e) as well as with regular rsync SST
    (IPv4, IPv6, TLS-e).

    Note that this initial support doesn't allow SST method
    to be updated via a stack update, as mariabackup requires
    a dedicated MySQL user, and there is currently no
    orchestration available via a minor update either.

    Closes-Bug: #1973872
    Depends-On: I1509bd30fbd253790b17e04ef15dca6c58de7311
    Depends-On: I4d5983ada52a58cdd853bd7b701bb11eeb88be8d

    (Fixed cherry-pick conflict in ContainerCli allowed_values)

    Change-Id: I6b797141800ae7f1773e9a06b232dacd158732f5
    (cherry picked from commit 4cceeebc86b99f76abaf15990e14d85406628be1)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to puppet-tripleo (stable/train)

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/c/openstack/puppet-tripleo/+/850994

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/train)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (stable/train)

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/c/openstack/tripleo-common/+/851001

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (stable/train)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/851001
Committed: https://opendev.org/openstack/tripleo-common/commit/dfc51dd05c9737cab2a5dd01e085c07e5883eaae
Submitter: "Zuul (22348)"
Branch: stable/train

commit dfc51dd05c9737cab2a5dd01e085c07e5883eaae
Author: Damien Ciabrini <email address hidden>
Date: Fri Apr 1 16:05:47 2022 +0200

    New dedicated user for Galera SST synchronization

    When the Galera is configured to use mariabackup, the
    synchronization takes place by connecting to the
    database with configuratble user credentials.
    Generate a random password for this use case.

    Related-Bug: #1973872

    (Fixed merge conflict manually to prevent backporting
    Ic7ff36a5f3f4eceeb6c8a338093e956b7db00533 with it)

    Change-Id: I1509bd30fbd253790b17e04ef15dca6c58de7311
    (cherry picked from commit 105a0c86276b7a27000707d35c760fc7d51905d0)
    (cherry picked from commit a1f50b819bcc9bf078876511de1c9bb2f24d2d05)
    (manually fixed cherry pick backport in test plan)

tags: added: in-stable-train
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to puppet-tripleo (stable/train)

Reviewed: https://review.opendev.org/c/openstack/puppet-tripleo/+/850994
Committed: https://opendev.org/openstack/puppet-tripleo/commit/47ef865b566ea37a4706f4cffce08067778d4ed4
Submitter: "Zuul (22348)"
Branch: stable/train

commit 47ef865b566ea37a4706f4cffce08067778d4ed4
Author: Damien Ciabrini <email address hidden>
Date: Fri Apr 1 16:23:53 2022 +0200

    Support mariabackup as a galera SST method

    In addition to rsync and rsync tunnelled over socat,
    expose the ability to use mariabackup in galera config.

    Related-Bug: #1973872

    Change-Id: I4d5983ada52a58cdd853bd7b701bb11eeb88be8d
    (cherry picked from commit 0d6db2428b2589f458328cc30445a963eeb863ee)
    (cherry picked from commit 688354081b782a526166d5d1416a104c096a0c21)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/train)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/851000
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/69f057e3120c5590359cb1a1dbd2e1e0984e3936
Submitter: "Zuul (22348)"
Branch: stable/train

commit 69f057e3120c5590359cb1a1dbd2e1e0984e3936
Author: Damien Ciabrini <email address hidden>
Date: Mon Apr 4 11:02:08 2022 +0200

    Galera: initial support for mariabackup SST

    When deploying a HA overcloud, allow the SST method to be
    configured, to use either rsync (default) or mariabackup.

    Tested by deploying a HA overcloud with mariabackup SST
    (IPv4, IPv6, TLS-e) as well as with regular rsync SST
    (IPv4, IPv6, TLS-e).

    Note that this initial support doesn't allow SST method
    to be updated via a stack update, as mariabackup requires
    a dedicated MySQL user, and there is currently no
    orchestration available via a minor update either.

    Closes-Bug: #1973872
    Depends-On: I1509bd30fbd253790b17e04ef15dca6c58de7311
    Depends-On: I4d5983ada52a58cdd853bd7b701bb11eeb88be8d

    (Fixed cherry-pick conflict in ContainerCli allowed_values)
    (Train: fixed cherry-pick conflict in hiera keys)

    Change-Id: I6b797141800ae7f1773e9a06b232dacd158732f5
    (cherry picked from commit 4cceeebc86b99f76abaf15990e14d85406628be1)
    (cherry picked from commit 24b1fe6ac3771a78832461d0613146583069cc0b)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 17.0.0

This issue was fixed in the openstack/tripleo-heat-templates 17.0.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates train-eol

This issue was fixed in the openstack/tripleo-heat-templates train-eol release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.