rdo-cloud yum repos unavailable during container updates and failing the undercloud install

Bug #1798195 reported by wes hayutin
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Unassigned

Bug Description

https://logs.rdoproject.org/19/611119/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/fb5bf9a/logs/undercloud/home/zuul/install-undercloud.log.txt.gz

  "puppet-zookeeper' ']'",
        "+ yum install -y yum-plugin-priorities",
        "\u001b[0mLoaded plugins: fastestmirror, ovl, priorities",
        "Determining fastest mirrors",
        "\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: [Errno 12] Timeout on http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: (28, 'Connection timed out after 30000 milliseconds')",
        "Trying other mirror.",
        "\u001b[0m\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: [Errno 12] Timeout on http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7/96/59/965941f1e62cef16967e7a7cd6d98263e52acb62_0989b280/repodata/repomd.xml: (28, 'Connection timed out after 30001 milliseconds')",
        "Trying other mirror.",
        "\u001b[0m\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org/centos/7/os/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - \"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\"",
        "\u001b[0m\u001b[91mTrying other mirror.",
        "",
        "",
        " One of the configured repositories failed (quickstart-centos-base),",
        " and yum doesn't have enough cached data to continue. At this point the only",
        " safe thing yum can do is fail. There are a few ways to work \"fix\" this:",
        "",
        " 1. Contact the upstream for the repository and get them to fix the problem.",
        "",
        " 2. Reconfigure the baseurl/etc. for the repository, to point to a working",
        " upstream. This is most often useful if you are using a newer",
        " distribution release than is supported by the repository (and the",
        " packages for the previous distribution release still work).",
        "",
        " 3. Run the command with the repository temporarily disabled",
        " yum --disablerepo=quickstart-centos-base ...",
        "",
        " 4. Disable the repository permanently, so yum won't use it by default. Yum",
        " will then just ignore the repository until you permanently enable it",
        " again or use --enablerepo for temporary usage:",
        "",
        " yum-config-manager --disable quickstart-centos-base",
        " or",
        " subscription-manager repos --disable=quickstart-centos-base",
        "",
        " 5. Configure the failing repository to be skipped, if it is unavailable.",
        " Note that yum will try to contact the repo. when it runs most commands,",
        " so will have to try and fail each time (and thus. yum will be be much",
        " slower). If it is a very temporary problem though, this is often a nice",
        " compromise:",
        "",
        " yum-config-manager --save --setopt=quickstart-centos-base.skip_if_unavailable=true",
        "",
        "failure: repodata/repomd.xml from quickstart-centos-base: [Errno 256] No more mirrors to try.",
        "http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org/centos/7/os/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - \"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\"",
        "\u001b[0m"
    ]
}

PLAY RECAP *********************************************************************
localhost : ok=16 changed=5 unreachable=0 failed=1

Tuesday 16 October 2018 18:51:42 +0000 (0:01:29.904) 0:01:38.957 *******
===============================================================================

Revision history for this message
Alan Pevec (apevec) wrote :

needinfo: does it still happen? This looks like it has hit a period with networking issues in rdocloud.

Revision history for this message
Martin Schuppert (mschuppert) wrote :

I see similar in [1]

================================================================================\\nUpgrade 34 Packages\\n\\nTotal download size: 2.2 M\\nDownloading packages:\\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\\n\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"\\n\\u001b[0m\\u001b[91mTrying other mirror.\\n\\u001b[0m\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/puppet-aodh-13.3.1-0.20181016002558.013e80f.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"\\n\\u001b[0m\\u001b[91mTrying other mirror.\\n\\u001b[0m\\u001b[91m\\n\\nError downloading packages:\\n openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch: [Errno 256] No more mirrors to try.\\n
...

, \n "Upgrade 34 Packages", \n "", \n "Total download size: 2.2 M", \n "Downloading packages:", \n "Delta RPMs disabled because /usr/bin/applydeltarpm not installed.", \n "\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"", \n "\\u001b[0m\\u001b[91mTrying other mirror.", \n "\\u001b[0m\\u001b[91mhttp://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8080/rdo/centos7-rocky/ef/1b/ef1b65baed2beeb713a1c5406be70233015a612f_b681ccb6/puppet-aodh-13.3.1-0.20181016002558.013e80f.el7.noarch.rpm: [Errno 14] curl#6 - \\"Could not resolve host: mirror.regionone.rdo-cloud-tripleo.rdoproject.org; Unknown error\\"", \n "\\u001b[0m\\u001b[91mTrying other mirror.", \n "\\u001b[0m\\u001b[91m", \n "", \n "Error downloading packages:", \n " openstack-tripleo-common-container-base-9.4.1-0.20181020102809.39ec3f6.el7.noarch: [Errno 256] No more mirrors to try.", \n " puppet-aodh-13.3.1-0.20181016002558.013e80f.el7.noarch: [Errno 256] No more mirrors to try.", \n "", \n "\\u001b[0m"\n ]\n}\n\nPLAY RECAP *********************************************************************\nlocalhost : ok=16 changed=5 unreachable=0 failed=1 \n\nMonday 22 October 2018 07:26:13 +0000 (0:01:06.686) 0:01:12.043 ********

[1] https://logs.rdoproject.org/17/611617/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035/a6e7bc9/logs/undercloud/home/zuul/install-undercloud.log.txt.gz

Revision history for this message
Tony Breeds (o-tony) wrote :
Changed in tripleo:
milestone: stein-1 → stein-2
Revision history for this message
Emilien Macchi (emilienm) wrote :

no update for more than a week, closing it.

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.