contrail container provisioning is broken

[Vedamurthy Joshi]

R4.0 Build 3057

http://anamika.englab.juniper.net:8080/job/kubernetes-sanity/28/console

TASK [node : Install python-docker-py in RedHat] *******************************
fatal: [10.204.217.194]: FAILED! => {"changed": false, "failed": true, "msg": "Failure talking to yum: failure: repodata/repomd.xml from contrail: [Errno 256] No more mirrors to try.\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\""}
fatal: [10.204.217.198]: FAILED! => {"changed": false, "failed": true, "msg": "Failure talking to yum: failure: repodata/repomd.xml from contrail: [Errno 256] No more mirrors to try.\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\""}
fatal: [10.204.217.197]: FAILED! => {"changed": false, "failed": true, "msg": "Failure talking to yum: failure: repodata/repomd.xml from contrail: [Errno 256] No more mirrors to try.\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml: [Errno 14] curl#7 - \"Failed connect to 10.204.217.194:1567; Connection refused\""}
 to retry, use: --limit @/home/root/jenkins/workspace/kubernetes-sanity/contrail-ansible/playbooks/site.retry

PLAY RECAP *********************************************************************
10.204.217.194 : ok=27 changed=14 unreachable=0 failed=1
10.204.217.197 : ok=27 changed=14 unreachable=0 failed=1
10.204.217.198 : ok=27 changed=14 unreachable=0 failed=1

[Nitish Krishna Kaveri (nitishk)]

Nagendra took a look at this

Failed connect to 10.204.217.194:1567; Connection refused\"\nhttp://10.204.217.194:1567/repodata/repomd.xml

Seems like this node is unable to connect to the repo container that is spawned to provision on RedHat. This bug is in internal ansible code, nothing to do with SM/External Ansible.

I am assigning back to Rudra as this is a Kubernetes/Centos sanity

Vedu, please give these details to Rudra and team because we do not know about Kubernetes provisioning

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/30783
Submitter: Ramprakash R (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/30783
Committed: http://github.com/Juniper/contrail-ansible/commit/f3fa8a3c6cc0cf4f1306573f7f39a480a6ae5bc8
Submitter: Zuul (<email address hidden>)
Branch: master

commit f3fa8a3c6cc0cf4f1306573f7f39a480a6ae5bc8
Author: Ramprakash <email address hidden>
Date: Wed Apr 26 16:41:05 2017 -0700

Closes-bug: #1683248 - For kubernetes (which relies on a repo container for packages) do not point apt/yum sources to the container until the container is launched

Change-Id: I1ebb9eb0cf03a73ec703cafa94d8c11aa2ed6804