Newton integrated build fails in nodepool when executing galera_server role

[Jesse Pretorius]

When executing the newton integrated build in nodepool on Xenial nodes only, the following error happens when executing the 'galera_server : Install galera_server role remote packages (apt)' task:

dpkg: error processing archive /var/cache/apt/archives/mariadb-client-core-10.0_10.0.32+maria-1~xenial_amd64.deb (--unpack):
conflicting packages - not installing mariadb-client-core-10.0
dpkg: regarding .../mariadb-client-10.0_10.0.32+maria-1~xenial_amd64.deb containing mariadb-client-10.0:
mariadb-client-core-10.0 conflicts with mysql-client-5.5
mariadb-client-10.0 provides mysql-client-5.5 and is to be installed.
dpkg: error processing archive /var/cache/apt/archives/mariadb-client-10.0_10.0.32+maria-1~xenial_amd64.deb (--unpack):
conflicting packages - not installing mariadb-client-10.0"

Example:
http://logs.openstack.org/66/496166/1/check/gate-openstack-ansible-openstack-ansible-aio-ubuntu-xenial-nv/435c79e/console.html#_2017-08-22_09_46_02_943939

[Jean-Philippe Evrard (jean-philippe-evrard)]

This could become critical if not fixed soon, when infra removes the trusty gates

[Jimmy McCrory (jimmy-mccrory)]

Think I've tracked this down.

The apt_package_pinning meta dependency isn't working as expected.
https://github.com/openstack/openstack-ansible-galera_server/blob/master/meta/main.yml#L36-L40

The role default for "galera_server_distro_package_pins" is empty and the value in vars/ubuntu-16.04.yml isn't loaded until the actual galera_server role begins.

Since we're not pinning to the MariaDB repo, the mariadb-client package is being installed from Ubuntu's repo which is causing the conflict when packages from the MariaDB are attempted to be installed alongside it.

This isn't effecting Ocata and up because they install 10.1, Ubuntu only is only providing 10.0, so they're always correctly using the MariaDB repo anyway.

[Jesse Pretorius (jesse-pretorius)]

Excellent triage Jimmy, thank you! I've proposed https://review.openstack.org/496503 based on the info provided.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/496505

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/496526

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496526
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=1faa81c5a197d86046e5e5e6de0aebf075277c0f
Submitter: Jenkins
Branch: master

commit 1faa81c5a197d86046e5e5e6de0aebf075277c0f
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 08:05:38 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ib99afee1a3bf9fba8d34c63ffa28e5fa41b73d03

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496505
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=c24d590d8acf808134e846f36a84fb23e88bd4ef
Submitter: Jenkins
Branch: master

commit c24d590d8acf808134e846f36a84fb23e88bd4ef
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 07:18:59 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ibc7766e96e478250b5e7d4788bb56dace974d25f

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/pike
Review: https://review.openstack.org/496731

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/496732

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/pike
Review: https://review.openstack.org/496733

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/496734

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/496735

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496738
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=1ac1d6482a95ef844d9288770c7fcf9c7c24dd75
Submitter: Jenkins
Branch: master

commit 1ac1d6482a95ef844d9288770c7fcf9c7c24dd75
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 15:37:15 2017 +0100

    Correct pin variable name

    The name used was for galera_server. This patch corrects it.

    Closes-Bug: #1712315
    Change-Id: I6cba66f41e9f36158275bf4f9172f83793eb6bc7

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496735
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=b6f095a1f7ae109f43fd3264ab5371c010a81ba8
Submitter: Jenkins
Branch: stable/newton

commit b6f095a1f7ae109f43fd3264ab5371c010a81ba8
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 08:05:38 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ib99afee1a3bf9fba8d34c63ffa28e5fa41b73d03
    (cherry picked from commit 1faa81c5a197d86046e5e5e6de0aebf075277c0f)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496733
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=3135940f0f5ed60dc908c37d8d8a7593b2debec8
Submitter: Jenkins
Branch: stable/pike

commit 3135940f0f5ed60dc908c37d8d8a7593b2debec8
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 08:05:38 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ib99afee1a3bf9fba8d34c63ffa28e5fa41b73d03
    (cherry picked from commit 1faa81c5a197d86046e5e5e6de0aebf075277c0f)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496734
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=abf0fe82fdfec45d3680fbf4b13c9ba26d685e0f
Submitter: Jenkins
Branch: stable/ocata

commit abf0fe82fdfec45d3680fbf4b13c9ba26d685e0f
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 08:05:38 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ib99afee1a3bf9fba8d34c63ffa28e5fa41b73d03
    (cherry picked from commit 1faa81c5a197d86046e5e5e6de0aebf075277c0f)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496732
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=21aed2dde52c29cb550707658bb9a2260d076f61
Submitter: Jenkins
Branch: stable/ocata

commit 21aed2dde52c29cb550707658bb9a2260d076f61
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 07:18:59 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ibc7766e96e478250b5e7d4788bb56dace974d25f
    (cherry picked from commit c24d590d8acf808134e846f36a84fb23e88bd4ef)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496731
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=c90dfd983da918c86ff9ec1b39db6de1e1671c6c
Submitter: Jenkins
Branch: stable/pike

commit c90dfd983da918c86ff9ec1b39db6de1e1671c6c
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 07:18:59 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ibc7766e96e478250b5e7d4788bb56dace974d25f
    (cherry picked from commit c24d590d8acf808134e846f36a84fb23e88bd4ef)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/496503
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=8bb346420d3d5d69fc37300fb47c7dcfb7534bc9
Submitter: Jenkins
Branch: stable/newton

commit 8bb346420d3d5d69fc37300fb47c7dcfb7534bc9
Author: Jesse Pretorius <email address hidden>
Date: Wed Aug 23 07:10:04 2017 +0100

    Fix MariaDB apt package pinning

    The variables in vars are only loaded when the include_vars
    task is run, which is after meta-dependencies are processed.

    This patch ensures that the pinning is properly applied when
    the meta-dependent role is executed.

    Closes-Bug: #1712315
    Change-Id: Ibc7766e96e478250b5e7d4788bb56dace974d25f
    (cherry picked from commit c24d590d8acf808134e846f36a84fb23e88bd4ef)

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/497412

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/497772

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/497412
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=acbc3e5c4799a27eda5d51552dde433b483bc509
Submitter: Jenkins
Branch: stable/newton

commit acbc3e5c4799a27eda5d51552dde433b483bc509
Author: Jesse Pretorius <email address hidden>
Date: Thu Aug 24 15:26:47 2017 +0100

    Update galera roles to include NB fixes

    To include the following fixes, the role SHA's are updated:
    https://review.openstack.org/496503
    https://review.openstack.org/496735
    https://review.openstack.org/497182

    Closes-Bug: #1712315
    Change-Id: I1f4b3339e4983a2d40bf82bab404acba762adb21

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/497770
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=a0149ebeaa01784c2bbc9236c6af5ad5ac73ff90
Submitter: Jenkins
Branch: master

commit a0149ebeaa01784c2bbc9236c6af5ad5ac73ff90
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:34:47 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: I7533d5908fd020469a5c8e3672c2adfdadced50e

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/497772
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=3f445dd5f57ca90f655d69d2ff5dfb04db0fb925
Submitter: Jenkins
Branch: master

commit 3f445dd5f57ca90f655d69d2ff5dfb04db0fb925
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:37:10 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: Ie809922396e0e29983126f98258b7b0f06e8766d

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/pike
Review: https://review.openstack.org/498157

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/498158

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/498159

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/pike
Review: https://review.openstack.org/498160

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/498161

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/498162

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible 14.2.8 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_client 14.2.8 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_server 14.2.8 release.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/498159
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=6b547f735b702c3f074aea45e6d481122bade7d2
Submitter: Jenkins
Branch: stable/newton

commit 6b547f735b702c3f074aea45e6d481122bade7d2
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:34:47 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: I7533d5908fd020469a5c8e3672c2adfdadced50e
    (cherry picked from commit a0149ebeaa01784c2bbc9236c6af5ad5ac73ff90)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/498158
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=545871d19ec69b91d80a6f2ffb200318255d574b
Submitter: Jenkins
Branch: stable/ocata

commit 545871d19ec69b91d80a6f2ffb200318255d574b
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:34:47 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: I7533d5908fd020469a5c8e3672c2adfdadced50e
    (cherry picked from commit a0149ebeaa01784c2bbc9236c6af5ad5ac73ff90)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/498157
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_client/commit/?id=e4701c9a8a7054b4443d57d627aade974f6ea759
Submitter: Jenkins
Branch: stable/pike

commit e4701c9a8a7054b4443d57d627aade974f6ea759
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:34:47 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: I7533d5908fd020469a5c8e3672c2adfdadced50e
    (cherry picked from commit a0149ebeaa01784c2bbc9236c6af5ad5ac73ff90)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/498162
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=75c71d5b181b304a97e24a15d960c6f2cd7be92e
Submitter: Jenkins
Branch: stable/newton

commit 75c71d5b181b304a97e24a15d960c6f2cd7be92e
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:37:10 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: Ie809922396e0e29983126f98258b7b0f06e8766d
    (cherry picked from commit 3f445dd5f57ca90f655d69d2ff5dfb04db0fb925)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/498161
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=9a33c61ac7d54b673caecf993bd075ed3757cdbf
Submitter: Jenkins
Branch: stable/ocata

commit 9a33c61ac7d54b673caecf993bd075ed3757cdbf
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:37:10 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: Ie809922396e0e29983126f98258b7b0f06e8766d
    (cherry picked from commit 3f445dd5f57ca90f655d69d2ff5dfb04db0fb925)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/498160
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible-galera_server/commit/?id=860028f3b05512d4b7b6b6faeb4832e35e341a15
Submitter: Jenkins
Branch: stable/pike

commit 860028f3b05512d4b7b6b6faeb4832e35e341a15
Author: Jesse Pretorius <email address hidden>
Date: Fri Aug 25 09:37:10 2017 +0100

    Remove duplicate package pinning variable

    The variable name is duplicated, resulting
    in only the last one being used and a warning
    from Ansible.

    Closes-Bug: #1712315
    Change-Id: Ie809922396e0e29983126f98258b7b0f06e8766d
    (cherry picked from commit 3f445dd5f57ca90f655d69d2ff5dfb04db0fb925)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_client 16.0.0.0rc2 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_server 16.0.0.0rc2 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_client 15.1.9 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_server 15.1.9 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_client 17.0.0.0b1 development milestone.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_server 17.0.0.0b1 development milestone.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_client 14.2.10 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_server 14.2.10 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_client 15.1.10 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/openstack-ansible-galera_server 15.1.10 release.