ubuntu integration jobs are failing because of broken idempotency

[Takashi Kajinami]

Currently ubuntu integration jobs are always failing.

Example:
https://zuul.opendev.org/t/openstack/build/7b961f7df5ca429aa537ac918d9a8688

The failure is caused by broken idepotency.
https://zuul.opendev.org/t/openstack/build/7b961f7df5ca429aa537ac918d9a8688/log/job-output.txt#5635-5637

Looking at puppet logs, the change detected in 2nd run is related to charset in database.

https://07bda34aab9549eeca55-002c6183c0f1ab9234471cb74705bd70.ssl.cf5.rackcdn.com/791628/11/check/puppet-openstack-integration-6-scenario001-tempest-ubuntu-focal/7b961f7/logs/puppet.txt
~~~
2021-05-18 09:48:16 +0000 /Stage[main]/Glance::Db::Mysql/Openstacklib::Db::Mysql[glance]/Mysql_database[glance]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:19 +0000 /Stage[main]/Neutron::Db::Mysql/Openstacklib::Db::Mysql[neutron]/Mysql_database[neutron]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:20 +0000 /Stage[main]/Placement::Db::Mysql/Openstacklib::Db::Mysql[placement]/Mysql_database[placement]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:26 +0000 /Stage[main]/Nova::Db::Mysql/Openstacklib::Db::Mysql[nova]/Mysql_database[nova]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:27 +0000 /Stage[main]/Nova::Db::Mysql/Openstacklib::Db::Mysql[nova_cell0]/Mysql_database[nova_cell0]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:27 +0000 /Stage[main]/Nova::Db::Mysql_api/Openstacklib::Db::Mysql[nova_api]/Mysql_database[nova_api]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:28 +0000 /Stage[main]/Cinder::Db::Mysql/Openstacklib::Db::Mysql[cinder]/Mysql_database[cinder]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:32 +0000 /Stage[main]/Aodh::Db::Mysql/Openstacklib::Db::Mysql[aodh]/Mysql_database[aodh]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:37 +0000 /Stage[main]/Heat::Db::Mysql/Openstacklib::Db::Mysql[heat]/Mysql_database[heat]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:37 +0000 /Stage[main]/Gnocchi::Db::Mysql/Openstacklib::Db::Mysql[gnocchi]/Mysql_database[gnocchi]/charset (notice): charset changed 'utf8mb3' to 'utf8'
2021-05-18 09:48:37 +0000 /Stage[main]/Panko::Db::Mysql/Openstacklib::Db::Mysql[panko]/Mysql_database[panko]/charset (notice): charset changed 'utf8mb3' to 'utf8'
~~~

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/804365

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Takashi Kajinami <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/791355
Reason: duplicate of https://review.opendev.org/c/openstack/puppet-openstack-integration/+/804365

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/804365
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/085d3569021441810c1dff7c8f4396003c690805
Submitter: "Zuul (22348)"
Branch: master

commit 085d3569021441810c1dff7c8f4396003c690805
Author: Takashi Kajinami <email address hidden>
Date: Thu Aug 12 17:48:51 2021 +0900

    Ubuntu: Use utf8mb3 charset in MySQL

    We are observing the failure in Ubuntu integration job caused by
    broken idempotency. It seems current mysql/mariadb in Ubuntu replaces
    utf8 with uft8mb3 automatically and this behavior results in unexpected
    change in second run.

    This change ensures that we use utf8mb3 in Ubuntu to avoid such
    mismatch caused by internal translation. Note this change is intended
    to be a quick gate fix and the charset would be updated to utf8mb4
    later.

    Closes-Bug: #1929073
    Change-Id: I7742120758057b5a00f1d093f355fda3791f4e02

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/805001

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/puppet-openstack-integration/+/805001
Committed: https://opendev.org/openstack/puppet-openstack-integration/commit/3771872b87b28030bbbcf8bb18ef8f97fde09106
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 3771872b87b28030bbbcf8bb18ef8f97fde09106
Author: Takashi Kajinami <email address hidden>
Date: Thu Aug 12 17:48:51 2021 +0900

    Ubuntu: Use utf8mb3 charset in MySQL

    We are observing the failure in Ubuntu integration job caused by
    broken idempotency. It seems current mysql/mariadb in Ubuntu replaces
    utf8 with uft8mb3 automatically and this behavior results in unexpected
    change in second run.

    This change ensures that we use utf8mb3 in Ubuntu to avoid such
    mismatch caused by internal translation. Note this change is intended
    to be a quick gate fix and the charset would be updated to utf8mb4
    later.

    Closes-Bug: #1929073
    Change-Id: I7742120758057b5a00f1d093f355fda3791f4e02
    (cherry picked from commit 085d3569021441810c1dff7c8f4396003c690805)