kolla.image.build.rabbitmq curl No such directory

[caowei]

INFO:kolla.image.build.rabbitmq: ---> Running in e59f62e1a97e
INFO:kolla.image.build.rabbitmq:c
INFO:kolla.image.build.rabbitmq:u
INFO:kolla.image.build.rabbitmq:r
INFO:kolla.image.build.rabbitmq:l
INFO:kolla.image.build.rabbitmq::
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:(
INFO:kolla.image.build.rabbitmq:2
INFO:kolla.image.build.rabbitmq:3
INFO:kolla.image.build.rabbitmq:)
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:F
INFO:kolla.image.build.rabbitmq:a
INFO:kolla.image.build.rabbitmq:i
INFO:kolla.image.build.rabbitmq:l
INFO:kolla.image.build.rabbitmq:e
INFO:kolla.image.build.rabbitmq:d
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:w
INFO:kolla.image.build.rabbitmq:r
INFO:kolla.image.build.rabbitmq:i
INFO:kolla.image.build.rabbitmq:t
INFO:kolla.image.build.rabbitmq:i
INFO:kolla.image.build.rabbitmq:n
INFO:kolla.image.build.rabbitmq:g
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:b
INFO:kolla.image.build.rabbitmq:o
INFO:kolla.image.build.rabbitmq:d
INFO:kolla.image.build.rabbitmq:y
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:(
INFO:kolla.image.build.rabbitmq:0
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:!
INFO:kolla.image.build.rabbitmq:=
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:1
INFO:kolla.image.build.rabbitmq:1
INFO:kolla.image.build.rabbitmq:7
INFO:kolla.image.build.rabbitmq:5
INFO:kolla.image.build.rabbitmq:)
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:curl (http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez): response: 200, time: 0.680, size: 1175
INFO:kolla.image.build.rabbitmq:Removing intermediate container e59f62e1a97e
ERROR:kolla.image.build.rabbitmq:Error'd with the following message
ERROR:kolla.image.build.rabbitmq:The command '/bin/sh -c rm -rf /var/lib/rabbitmq/* && curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.5.7/plugins/rabbitmq_clusterer-3.5.x-189b3a81.ez http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez && /usr/lib/rabbitmq/bin/rabbitmq-plugins enable --offline rabbitmq_management rabbitmq_clusterer && /bin/true' returned a non-zero code: 23
INFO:kolla.image.build:Attempting to run task BuildTask(rabbitmq) for the 4 time
INFO:kolla.image.build.rabbitmq:Building
INFO:kolla.image.build.rabbitmq:Directory /tmp/kolla-2016-08-10_08-03-21_0EQaKy/docker/rabbitmq/plugins already exist. Skipping.
INFO:kolla.image.build.rabbitmq:Step 1 : FROM kolla/centos-binary-base:2.0.2
INFO:kolla.image.build.rabbitmq: ---> 1314849f4b1b
INFO:kolla.image.build.rabbitmq:Step 2 : MAINTAINER Kolla Project (https://launchpad.net/kolla)
INFO:kolla.image.build.rabbitmq: ---> Using cache
INFO:kolla.image.build.rabbitmq: ---> 756b017f36f9
INFO:kolla.image.build.rabbitmq:Step 3 : RUN yum -y install hostname https://github.com/rabbitmq/rabbitmq-server/releases/download/rabbitmq_v3_5_7/rabbitmq-server-3.5.7-1.noarch.rpm && yum clean all
INFO:kolla.image.build.rabbitmq: ---> Using cache
INFO:kolla.image.build.rabbitmq: ---> 85dace154de3
INFO:kolla.image.build.rabbitmq:Step 4 : RUN rm -rf /var/lib/rabbitmq/* && curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.5.7/plugins/rabbitmq_clusterer-3.5.x-189b3a81.ez http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez && /usr/lib/rabbitmq/bin/rabbitmq-plugins enable --offline rabbitmq_management rabbitmq_clusterer && /bin/true
INFO:kolla.image.build.rabbitmq: ---> Running in 5db289d83915
INFO:kolla.image.build.rabbitmq:curl (http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez): response: 200, time: 0.648, size: 1175
INFO:kolla.image.build.rabbitmq:curl: (23) Failed writing body (0 != 1175)
INFO:kolla.image.build.rabbitmq:
INFO:kolla.image.build.rabbitmq:Removing intermediate container 5db289d83915
ERROR:kolla.image.build.rabbitmq:Error'd with the following message
ERROR:kolla.image.build.rabbitmq:The command '/bin/sh -c rm -rf /var/lib/rabbitmq/* && curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.5.7/plugins/rabbitmq_clusterer-3.5.x-189b3a81.ez http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez && /usr/lib/rabbitmq/bin/rabbitmq-plugins enable --offline rabbitmq_management rabbitmq_clusterer && /bin/true' returned a non-zero code: 23
INFO:kolla.image.build:=========================
INFO:kolla.image.build:Successfully built images
INFO:kolla.image.build:=========================
INFO:kolla.image.build:base
INFO:kolla.image.build:===========================
INFO:kolla.image.build:Images that failed to build
INFO:kolla.image.build:===========================
ERROR:kolla.image.build:rabbitmq Failed with status: error

[caowei (caowei-e)]

root@kolla:~# curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.5.7/plugins/rabbitmq_clusterer-3.5.x-189b3a81.ez http://www.rabbitmq.com/community-plugins/v3.5.x/rabbitmq_clusterer-3.5.x-189b3a81.ez
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
  0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0Warning: Failed to create the file
Warning: /usr/lib/rabbitmq/lib/rabbitmq_server-3.5.7/plugins/rabbitmq_clusterer
Warning: -3.5.x-189b3a81.ez: No such file or directory
  2 54739 2 1175 0 0 1485 0 0:00:36 --:--:-- 0:00:36 1485
curl: (23) Failed writing body (0 != 1175)

[Martin Matyáš (martinx-maty)]

I can see that error currently. Root cause: hard-coded version directories in docker/rabbitmq/Dockerfile.j2:
"curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.6.2/plugins/...."

while rabbitmq_server package from delorean is currently bumped to 3.6.5. Curl dies on non-existing directory /usr/lib/rabbitmq/lib/rabbitmq_server-3.6.2

Hard-coding version dependencies on a package in delorean is error prone as kolla does not have any control on what is changed in delorean repo.

[Jeffrey Zhang (jeffrey4l)]

here is the fix.

https://review.openstack.org/#/c/379960/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/379960
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=0226cca1a25c59ace8433650c81f83d0b78d9a33
Submitter: Jenkins
Branch: master

commit 0226cca1a25c59ace8433650c81f83d0b78d9a33
Author: Steven Dake <email address hidden>
Date: Thu Sep 29 23:50:33 2016 -0700

    Download the rabbitmq_clusterer plugins to the correct path

    rabbitmq-server version upgrade to 3.6.5 in RDO repo. This patch set

    * Download the rabbitmq_clusterer plugins to the correct path
    * Install 3.6.5 rabbitmq-server for Ubuntu/Debian distro

    Closes-Bug: #1611655
    Co-Authored-by: Jeffrey Zhang <email address hidden>
    Change-Id: I8de9a553b506a15f4d96cc6b55f21e3a27887a1d

[Dave Walker (davewalker)]

This looks unresolved to me:
INFO:kolla.image.build.rabbitmq:Building
INFO:kolla.image.build.rabbitmq:Directory /tmp/kolla-2016-10-03_08-32-26_5mHQ6n/docker/rabbitmq/plugins already exist. Skipping.
INFO:kolla.image.build.rabbitmq:Step 1 : FROM 127.0.0.1:4000/local/centos-source-base:3.0.0
INFO:kolla.image.build.rabbitmq: ---> 902f5744d68a
INFO:kolla.image.build.rabbitmq:Step 2 : MAINTAINER Kolla Project (https://launchpad.net/kolla)
INFO:kolla.image.build.rabbitmq: ---> Using cache
INFO:kolla.image.build.rabbitmq: ---> 6f01002cdb65
INFO:kolla.image.build.rabbitmq:Step 3 : RUN yum -y install hostname rabbitmq-server && yum clean all
INFO:kolla.image.build.rabbitmq: ---> Using cache
INFO:kolla.image.build.rabbitmq: ---> 51a74df7e23f
INFO:kolla.image.build.rabbitmq:Step 4 : RUN rm -rf /var/lib/rabbitmq/* && curl -o /usr/lib/rabbitmq/lib/rabbitmq_server-3.6.5/plugins/rabbitmq_clusterer-3.6.x-667f92b0.ez http://www.rabbitmq.com/community-plugins/v3.6.x/rabbitmq_clusterer-3.6.x-667f92b0.ez && /usr/lib/rabbitmq/bin/rabbitmq-plugins enable --offline rabbitmq_management rabbitmq_clusterer && /bin/true
INFO:kolla.image.build.rabbitmq: ---> Running in f2a63dc3dd42
INFO:kolla.image.build.rabbitmq:ESC[91mcurl: (23) Failed writing body (0 != 3186)
INFO:kolla.image.build.rabbitmq:ESC[0m
INFO:kolla.image.build.rabbitmq:curl (http://www.rabbitmq.com/community-plugins/v3.6.x/rabbitmq_clusterer-3.6.x-667f92b0.ez): response: 200, time: 0.112, size: 3186
INFO:kolla.image.build.rabbitmq:Removing intermediate container f2a63dc3dd42

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla 3.0.0.0rc2 release candidate.