requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://auth.docker.io/token?s

[wes hayutin]

    ERROR:root:Image prepare failed: 500 Server Error: Internal Server Error for url: https://auth.docker.io/token?service=registry.docker.io&scope=repository%3Atripleomaster%2Fcentos-binary-cron%3Apull
    Traceback (most recent call last):
      File "/usr/bin/tripleo-container-image-prepare", line 138, in <module>
        lock=lock)
      File "/usr/lib/python3.6/site-packages/tripleo_common/image/kolla_builder.py", line 215, in container_images_prepare_multi
        lock=lock
      File "/usr/lib/python3.6/site-packages/tripleo_common/image/kolla_builder.py", line 344, in container_images_prepare
        images, modify_only_with_labels)
      File "/usr/lib/python3.6/site-packages/tripleo_common/image/image_uploader.py", line 980, in filter_images_with_labels
        url, username=username, password=password)
      File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 292, in wrapped_f
        return self.call(f, *args, **kw)
      File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 358, in call
        do = self.iter(retry_state=retry_state)
      File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 331, in iter
        raise retry_exc.reraise()
      File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 167, in reraise
        raise self.last_attempt.result()
      File "/usr/lib64/python3.6/concurrent/futures/_base.py", line 425, in result
        return self.__get_result()
      File "/usr/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result
        raise self._exception
      File "/usr/lib/python3.6/site-packages/tenacity/__init__.py", line 361, in call
        result = fn(*args, **kwargs)
      File "/usr/lib/python3.6/site-packages/tripleo_common/image/image_uploader.py", line 646, in authenticate
        rauth.raise_for_status()
      File "/usr/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status
        raise HTTPError(http_error_msg, response=self)
    requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://auth.docker.io/token?service=registry.docker.io&scope=repository%3Atripleomaster%2Fcentos-binary-cron%3Apull
  stderr_lines: <omitted>
  stdout: ''
  stdout_lines: <omitted>

NO MORE HOSTS LEFT ************

https://1d99560c221207a33e89-14a854fbbf5a230846aba3c6a65bcd80.ssl.cf5.rackcdn.com/714065/3/gate/tripleo-ci-centos-8-containers-multinode/d1d8682/logs/undercloud/home/zuul/undercloud_install.log

https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_098/714065/3/gate/tripleo-ci-centos-8-undercloud-containers/098cf9e/logs/undercloud/home/zuul/undercloud_install.log

[Bogdan Dobrelya (bogdando)]

At least there had been retries before the final failure https://1d99560c221207a33e89-14a854fbbf5a230846aba3c6a65bcd80.ssl.cf5.rackcdn.com/714065/3/gate/tripleo-ci-centos-8-containers-multinode/d1d8682/logs/undercloud/var/log/tripleo-container-image-prepare.log

So there is probably not much can be improved on the image uploader side?

[wes hayutin (weshayutin)]

Thanks @Bogdan!
Looks ok now
http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-undercloud-containers