Upgrade M-N fails installing galera packages

[Luz Cazares]

When upgrading Mitaka to Newton via run_upgrade.sh
Process fails on play galera_install_apt.yml "Install galera packages" task.
https://github.com/openstack/openstack-ansible-galera_server/blob/master/tasks/galera_install_apt.yml#L141

Full path run_upgrade.sh -> galera-install.yml -> galera_server role -> galera_install.yml -> galera_install_apt.yml

TASK [galera_server : Install galera packages] *********************************
FAILED - RETRYING: TASK: galera_server : Install galera packages (5 retries left).
FAILED - RETRYING: TASK: galera_server : Install galera packages (4 retries left).
FAILED - RETRYING: TASK: galera_server : Install galera packages (3 retries left).
FAILED - RETRYING: TASK: galera_server : Install galera packages (2 retries left).
FAILED - RETRYING: TASK: galera_server : Install galera packages (1 retries left).
failed: [infra01_galera_container-85fda080] (item=[u'mariadb-client', u'mariadb-galera-server-10.0', u'galera-3', u'rsync', u'socat']) => {"cache_update_time": 0, "cache_updated": false, "failed": true, "item": ["mariadb-client", "mariadb-galera-server-10.0", "galera-3", "rsync", "socat"], "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\" install 'mariadb-galera-server-10.0'' failed: E: Package 'mariadb-galera-server-10.0' has no installation candidate\n", "stderr": "E: Package 'mariadb-galera-server-10.0' has no installation candidate\n", "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nPackage mariadb-galera-server-10.0 is not available, but is referred to by another package.\nThis may mean that the package is missing, has been obsoleted, or\nis only available from another source\n\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Package mariadb-galera-server-10.0 is not available, but is referred to by another package.", "This may mean that the package is missing, has been obsoleted, or", "is only available from another source", ""]}

[Jesse Pretorius (jesse-pretorius)]

I suspect it may have something to do with https://github.com/openstack/openstack-ansible/blob/master/scripts/run-upgrade.sh#L154

[Jesse Pretorius (jesse-pretorius)]

Please can you provide the details of the commit/tag that was being migrated from and to?

[Michael Gugino (gugino-michael)]

I attempted this upgrade with the following:

Host: Trusty 3.19.0-69-generic
Mitaka deployed as AIO on stable/mitaka branch.
Used master branch for Newton upgrade (current master at time of writing this).

Results: I was unable to reproduce the error on the AIO.

[Mohammed Naser (mnaser)]

These releases are no longer supported upstream :)

[Dmitriy Rabotyagov (noonedeadpunk)]

The same stuff I see during T->U upgrade:
http://paste.openstack.org/show/785812/

[Dmitriy Rabotyagov (noonedeadpunk)]

It's not same but still matters;)

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/693043

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/693043
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=efc965f00fc515a46d03fcf22270ebc7bb8e4791
Submitter: Zuul
Branch: master

commit efc965f00fc515a46d03fcf22270ebc7bb8e4791
Author: Dmitriy Rabotyagov <email address hidden>
Date: Tue Nov 5 18:31:53 2019 +0200

    Restart mysql when package is installed

    When running galera_server role with galera_upgrade=true
    it uninstalls mariadb and installs again. In some distros, like CentOS,
    mariadb don't start automatically after installation, so upgrade fails.

    This patch adds handler on packsage installation, which will be
    triggered when package state is changed.

    Change-Id: I23811cfaf23007c5da1860e78397be380d67403b
    Related-bug: 1628720

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/693172

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/stein
Review: https://review.opendev.org/693173

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/693173
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=fbc410f82d44e7e457d6b6a92948132e4a0572a1
Submitter: Zuul
Branch: stable/stein

commit fbc410f82d44e7e457d6b6a92948132e4a0572a1
Author: Dmitriy Rabotyagov <email address hidden>
Date: Tue Nov 5 18:31:53 2019 +0200

    Restart mysql when package is installed

    When running galera_server role with galera_upgrade=true
    it uninstalls mariadb and installs again. In some distros, like CentOS,
    mariadb don't start automatically after installation, so upgrade fails.

    This patch adds handler on packsage installation, which will be
    triggered when package state is changed.

    Change-Id: I23811cfaf23007c5da1860e78397be380d67403b
    Related-bug: 1628720
    (cherry picked from commit efc965f00fc515a46d03fcf22270ebc7bb8e4791)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/693172
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=be36ddb6cd9a03d772239b9de0e9f6ea2249c945
Submitter: Zuul
Branch: stable/train

commit be36ddb6cd9a03d772239b9de0e9f6ea2249c945
Author: Dmitriy Rabotyagov <email address hidden>
Date: Tue Nov 5 18:31:53 2019 +0200

    Restart mysql when package is installed

    When running galera_server role with galera_upgrade=true
    it uninstalls mariadb and installs again. In some distros, like CentOS,
    mariadb don't start automatically after installation, so upgrade fails.

    This patch adds handler on package installation, which will be
    triggered when package state is changed.

    Depends-On: https://review.opendev.org/694759/
    Change-Id: I23811cfaf23007c5da1860e78397be380d67403b
    Related-bug: 1628720
    (cherry picked from commit efc965f00fc515a46d03fcf22270ebc7bb8e4791)