rdo-cloud yum repos unavailable during container updates and failing the undercloud install

Bug #1798195 reported by wes hayutin on 2018-10-16
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Critical
Unassigned

Bug Description

https://logs.rdoproject.org/19/611119/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/fb5bf9a/logs/undercloud/home/zuul/install-undercloud.log.txt.gz

  "puppet-zookeeper' ']'",
        "+ yum install -y yum-plugin-priorities",
        "\u001b[0mLoaded plugins: fastestmirror, ovl, priorities",
        "Determining fastest mirrors",
        "\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: [Errno 12] Timeout on http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: (28, 'Connection timed out after 30000 milliseconds')",
        "Trying other mirror.",
        "\u001b[0m\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: [Errno 12] Timeout on http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: (28, 'Connection timed out after 30001 milliseconds')",
        "Trying other mirror.",
        "\u001b[0m\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org/centos/7/os/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - \"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\"",
        "\u001b[0m\u001b[91mTrying other mirror.",
        "",
        "",
        " One of the configured repositories failed (quickstart-centos-base),",
        " and yum doesn't have enough cached data to continue. At this point the only",
        " safe thing yum can do is fail. There are a few ways to work \"fix\" this:",
        "",
        " 1. Contact the upstream for the repository and get them to fix the problem.",
        "",
        " 2. Reconfigure the baseurl/etc. for the repository, to point to a working",
        " upstream. This is most often useful if you are using a newer",
        " distribution release than is supported by the repository (and the",
        " packages for the previous distribution release still work).",
        "",
        " 3. Run the command with the repository temporarily disabled",
        " yum --disablerepo=quickstart-centos-base ...",
        "",
        " 4. Disable the repository permanently, so yum won't use it by default. Yum",
        " will then just ignore the repository until you permanently enable it",
        " again or use --enablerepo for temporary usage:",
        "",
        " yum-config-manager --disable quickstart-centos-base",
        " or",
        " subscription-manager repos --disable=quickstart-centos-base",
        "",
        " 5. Configure the failing repository to be skipped, if it is unavailable.",
        " Note that yum will try to contact the repo. when it runs most commands,",
        " so will have to try and fail each time (and thus. yum will be be much",
        " slower). If it is a very temporary problem though, this is often a nice",
        " compromise:",
        "",
        " yum-config-manager --save --setopt=quickstart-centos-base.skip_if_unavailable=true",
        "",
        "failure: repodata/repomd.xml from quickstart-centos-base: [Errno 256] No more mirrors to try.",
        "http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org/centos/7/os/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - \"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\"",
        "\u001b[0m"
    ]
}

PLAY RECAP *********************************************************************
localhost : ok=16 changed=5 unreachable=0 failed=1

Tuesday 16 October 2018 18:51:42 +0000 (0:01:29.904) 0:01:38.957 *******
===============================================================================

Alan Pevec (apevec) wrote :

needinfo: does it still happen? This looks like it has hit a period with networking issues in rdocloud.

Martin Schuppert (mschuppert) wrote :

I see similar in [1]

================================================================================\\nUpgrade 34 Packages\\n\\nTotal download size: 2.2 M\\nDownloading packages:\\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\\n\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"\\n\\u001b[0m\\u001b[91mTrying other mirror.\\n\\u001b[0m\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/puppet-aodh-13.3.1-0.20181016002558.013e80f.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"\\n\\u001b[0m\\u001b[91mTrying other mirror.\\n\\u001b[0m\\u001b[91m\\n\\nError downloading packages:\\n openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch: [Errno 256] No more mirrors to try.\\n
...

, \n "Upgrade 34 Packages", \n "", \n "Total download size: 2.2 M", \n "Downloading packages:", \n "Delta RPMs disabled because /usr/bin/applydeltarpm not installed.", \n "\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"", \n "\\u001b[0m\\u001b[91mTrying other mirror.", \n "\\u001b[0m\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/puppet-aodh-13.3.1-0.20181016002558.013e80f.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"", \n "\\u001b[0m\\u001b[91mTrying other mirror.", \n "\\u001b[0m\\u001b[91m", \n "", \n "Error downloading packages:", \n " openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch: [Errno 256] No more mirrors to try.", \n " puppet-aodh-13.3.1-0.20181016002558.013e80f.el7.noarch: [Errno 256] No more mirrors to try.", \n "", \n "\\u001b[0m"\n ]\n}\n\nPLAY RECAP *********************************************************************\nlocalhost : ok=16 changed=5 unreachable=0 failed=1 \n\nMonday 22 October 2018 07:26:13 +0000 (0:01:06.686) 0:01:12.043 ********

[1] https://logs.rdoproject.org/17/611617/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035/a6e7bc9/logs/undercloud/home/zuul/install-undercloud.log.txt.gz

Changed in tripleo:
milestone: stein-1 → stein-2
Emilien Macchi (emilienm) wrote :

no update for more than a week, closing it.

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers