docker image build failure due to upstream repo issues

[Scott Little]

Brief Description
-----------------
Docker images builds sometime fail due to 404/502/503 errors when an upstream repo is updating or perhaps doing other maintenance. Failures can strike any of these internet dependent build steps ...
   build-stx-base.sh ...
   build-wheel-tarball.sh ...
   build-stx-images.sh

I think we need retry logic within this family of scripts.

Severity
--------
Major: Failed builds

Steps to Reproduce
------------------
build-stx-base.sh ...
build-wheel-tarball.sh ...
build-stx-images.sh ...

Expected Behavior
------------------
Successful build

Actual Behavior
----------------
Build failure

Reproducibility
---------------
Intermittent, perhaps 25% for overnight dev builds

System Configuration
--------------------
N/A

Branch/Pull Time/Commit
-----------------------
N/A

Last Pass
---------

Timestamp/Logs
--------------

Several examples ....

http://mirror.centos.org/centos/7/cloud/x86_64/openstack-queens/mariadb-10.1.20-2.el7.x86_64.rpm: [Errno 14] HTTP Error 502 - Bad Gateway
Error downloading packages:
  3:mariadb-10.1.20-2.el7.x86_64: [Errno 256] No more mirrors to try.

-------------
############################################################
Building pycryptodomex-3.7.3-cp27-none-linux_x86_64.whl
############################################################
--2019-04-09 03:52:14-- https://files.pythonhosted.org/packages/9e/ed/e44c54a648fdfa56bf0682cd94b03303fa74a70e964c86acbbedf992afbe/pycryptodomex-3.7.3.tar.gz
Resolving files.pythonhosted.org (files.pythonhosted.org)... 151.101.1.63, 151.101.65.63, 151.101.129.63, ...
Connecting to files.pythonhosted.org (files.pythonhosted.org)|151.101.1.63|:443... connected.
HTTP request sent, awaiting response... 503 first byte timeout
2019-04-09 03:53:16 ERROR 503: first byte timeout.

Failure running: wget https://files.pythonhosted.org/packages/9e/ed/e44c54a648fdfa56bf0682cd94b03303fa74a70e964c86acbbedf992afbe/pycryptodomex-3.7.3.tar.gz

------------
https://dl.fedoraproject.org/pub/epel/testing/7/SRPMS/repodata/1e95e9927860917a913156f6d1497f8e5148905e3d808dd2a72238364352a077-updateinfo.xml.bz2: [Errno 14] HTTPS Error 404 - Not Found
Trying other mirror.
To address this issue please refer to the below knowledge base article

https://access.redhat.com/articles/1320623
...

Test Activity
-------------
Build

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/651374

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/651374
Committed: https://git.openstack.org/cgit/openstack/stx-root/commit/?id=492b5b218d0a01263714d94ded931b03fa608477
Submitter: Zuul
Branch: master

commit 492b5b218d0a01263714d94ded931b03fa608477
Author: Don Penney <email address hidden>
Date: Tue Apr 9 16:17:22 2019 -0400

    Retries for certain wheel and image build commands

    The wheel and image build tools hit intermittent issues such as:
    * Network or server issues that cause file download failures
    * Repo access failures due to repo updates or other issues

    To avoid formal build failures on such issues, this update adds
    retries around specific commands, like wget and docker build.

    Change-Id: Ifafdc6201872f43b2dd77efd4dcb033456477c2e
    Closes-Bug: 1823986
    Signed-off-by: Don Penney <email address hidden>