fuel-createmirror requires internet access to docker repository and fails by default if it can't access it

[Alex Schultz]

The fuel-createmirror script tries to reach out to the index.docker.io repository to pull down an image as part of the repository sync process. If the user does not allow access to this it fails with a error message "* FATAL: Cannot calculate list of dependencies" that does not point to what the problem actually is.

Once a user turns on debugging, we can see that the script was unable to pull down the docker image.

Script log: http://paste.openstack.org/show/419543/
ubuntu-ubuntu.log: http://paste.openstack.org/show/419544/

We need to improve the error message around this and document the required network connectivity for the fuel-createmirror script. We should provide a complete list of urls that may need to be whitelisted in order for the local mirror creation process to work.

UX impact poor error messaging, lack of documentation

[krogon-intel (krogon-intel)]

I thing that this docker should be stored locally.

[krogon-intel (krogon-intel)]

The precheck will use proxy configuration from ./config/common.cfg (or ENV variables) which may work (False-Positive).
Proxy for docker have to be set separately in /etc/sysconfig/docker.

BTW. How to run fuel-createmirror in debbuging mode. It was a bit hard for me to find out the root cause.

[Alex Schultz (alex-schultz)]

To run fuel-createmirror in debug, edit /etc/fuel-createmirror/ubuntu.cfg and mos-ubuntu.cfg and change DEBUG="yes"

[Sheena Conant (sheena-conant)]

We're discussing removing MOS DEB from the ISO, which is the reason for the elevated priority. This needs to be addressed immediately if we're going to continue to pull content from the ISO and expect users to use the fuel-createmirror script to pull everything down.

[Andrey Maximov (maximov)]

Moving out of 7.0 scope since we cannot fix High bugs after HCF

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/234779

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/234779
Committed: https://git.openstack.org/cgit/stackforge/fuel-mirror/commit/?id=fe81731b76071dc0a4ffdf039080732243f5a871
Submitter: Jenkins
Branch: master

commit fe81731b76071dc0a4ffdf039080732243f5a871
Author: Bulat Gaifullin <email address hidden>
Date: Wed Oct 14 16:00:44 2015 +0300

    Check that docker-container runs successfully.

    Break execution with error message in case if
    the docker fails to start new container.

    Change-Id: I2880a0a569dc3a56a73c0f9deea018f5b626ae10
    Closes-bug: #1485758

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/7.0
Review: https://review.openstack.org/235772

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/235772
Committed: https://git.openstack.org/cgit/openstack/fuel-mirror/commit/?id=9c00e595b49f87575a0ae4c877c5f5b519853683
Submitter: Jenkins
Branch: stable/7.0

commit 9c00e595b49f87575a0ae4c877c5f5b519853683
Author: Bulat Gaifullin <email address hidden>
Date: Wed Oct 14 16:00:44 2015 +0300

    Check that docker-container runs successfully.

    Break execution with error message in case if
    the docker fails to start new container.

    Change-Id: I2880a0a569dc3a56a73c0f9deea018f5b626ae10
    Closes-bug: #1485758
    (cherry picked from commit fe81731b76071dc0a4ffdf039080732243f5a871)

[Andrey Sledzinskiy (asledzinskiy)]

verified on 7.0-301 iso with MU

[Nastya Urlapova (aurlapova)]

Moved to Fix Released according to a comment above.

[Jeff Wong (jeff-ny-wong)]

How can I download the patch since I encountered the same problem.

[EP KOMARLA (ep-komarla)]

Please tell me how to get this patch - I am seeing the same error

[Alex Schultz (alex-schultz)]

If you are receiving an error about docker, please see bug https://bugs.launchpad.net/fuel/+bug/1528498

[Dmitriy Kruglov (dkruglov)]

Fuel-createmirror was deprecated and replaced by fuel-mirror in 8.0.