overcloud upgrade converge failed on "Lost connection to MySQL server during query"

[Thomas Herve]

Original bug: https://bugzilla.redhat.com/show_bug.cgi?id=1601449

This is related to the convergence change we made in queens on the undercloud. Heat now uses more greenthread, so when the system is under load, it may take quite some time to switch between all of them. If it happens while it's trying to connect to mysql, it will times out after 10s. To take this into account, I think it's safe to raise the timeout a bit, as we don't expose that mysql instance so there is no attack vector.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/586275
Committed: https://git.openstack.org/cgit/openstack/instack-undercloud/commit/?id=98592c2b073aeff340a32b11f7ac827db6090de0
Submitter: Zuul
Branch: master

commit 98592c2b073aeff340a32b11f7ac827db6090de0
Author: Thomas Herve <email address hidden>
Date: Thu Jul 26 17:45:32 2018 +0200

    Set connect_timeout in mysql

    This sets the connect_timeout in mysqld, to work around issues with Heat
    losing connection to MySQL in the undercloud under load.

    Closes-Bug: #1783995
    Change-Id: Ia3799cdaf171892431151e4f2f7d2095081b8242

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/589179

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/589179
Committed: https://git.openstack.org/cgit/openstack/instack-undercloud/commit/?id=71eee577153fb0acb325e2e5813b8be52f8b8167
Submitter: Zuul
Branch: stable/queens

commit 71eee577153fb0acb325e2e5813b8be52f8b8167
Author: Thomas Herve <email address hidden>
Date: Thu Jul 26 17:45:32 2018 +0200

    Set connect_timeout in mysql

    This sets the connect_timeout in mysqld, to work around issues with Heat
    losing connection to MySQL in the undercloud under load.

    Closes-Bug: #1783995
    Change-Id: Ia3799cdaf171892431151e4f2f7d2095081b8242
    (cherry picked from commit 98592c2b073aeff340a32b11f7ac827db6090de0)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/instack-undercloud 9.3.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/instack-undercloud 8.4.5 release.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/586282
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=25901f8c536890c759ffca3e4d268e84ffe9579d
Submitter: Zuul
Branch: master

commit 25901f8c536890c759ffca3e4d268e84ffe9579d
Author: Thomas Herve <email address hidden>
Date: Thu Jul 26 17:51:31 2018 +0200

    Set mysql connect timeout in the undercloud

    This sets the mysql connect timeout in the containerized undercloud
    case. It mirrors Ia3799cdaf171892431151e4f2f7d2095081b8242.

    Related-Bug: #1783995
    Change-Id: I727a38eb537f83accadca9ee7f38bd7ace62500e

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/rocky
Review: https://review.openstack.org/606774

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/606774
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=74d821a92a689fede2c1980a1b14df0b29aa65c7
Submitter: Zuul
Branch: stable/rocky

commit 74d821a92a689fede2c1980a1b14df0b29aa65c7
Author: Thomas Herve <email address hidden>
Date: Thu Jul 26 17:51:31 2018 +0200

    Set mysql connect timeout in the undercloud

    This sets the mysql connect timeout in the containerized undercloud
    case. It mirrors Ia3799cdaf171892431151e4f2f7d2095081b8242.

    Related-Bug: #1783995
    Change-Id: I727a38eb537f83accadca9ee7f38bd7ace62500e
    (cherry picked from commit 25901f8c536890c759ffca3e4d268e84ffe9579d)