"Add in cinder devices types" task failing

[Tiago]

The "Add in cinder devices types" task is failing with an "ERROR: Service Unavailable (HTTP 503)" error.

It looks like that the test on the task before "Increase delay for waiting for cinder api" is not enough to verify that the service is ready.

When I run the cinder playbook again, this time succeeds though.

I looked into the logs of every cinder service and the only thing that catched my eye was the cinder-volume log, with shows a "caught SIGTERM, stopping children" message. Not sure whether it matters.

I am using HAProxy, if that is relevant.

[Jesse Pretorius (jesse-pretorius)]

We need to implement a better API up check, and perhaps implement some retries or a more configurable delay.

[git-harry (git-harry)]

@Tiago - the relevant logs for this error are from cinder-api. The cinder-volume service is not required by the cinder type-create/type-key tasks in the task 'Add in cinder devices types'.

[Hugh Saunders (hughsaunders)]

I am attempting to address this bug in: https://review.openstack.org/256414

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/256414
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=eab4b15aeb1204989355705fe2ecdf184d8bbb8b
Submitter: Jenkins
Branch: master

commit eab4b15aeb1204989355705fe2ecdf184d8bbb8b
Author: Hugh Saunders <email address hidden>
Date: Fri Dec 11 13:10:41 2015 +0000

    Use http request to check cinder api availability

    Using a port open check is not reliable when going through a load
    balancer.

    httplib2 is added as it is required by the Ansible uri module.

    Change-Id: I0e489e8f671b262c56c1442e7af85fd53c061598
    Closes-bug: #1525208
    Closes-Bug: #1510990

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/276784
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=9d03db957aca27f28af994131dd25a1a70bd05c8
Submitter: Jenkins
Branch: liberty

commit 9d03db957aca27f28af994131dd25a1a70bd05c8
Author: Hugh Saunders <email address hidden>
Date: Fri Dec 11 13:10:41 2015 +0000

    Use http request to check cinder api availability

    Using a port open check is not reliable when going through a load
    balancer.

    httplib2 is added as it is required by the Ansible uri module.

    Change-Id: I0e489e8f671b262c56c1442e7af85fd53c061598
    Closes-bug: #1525208
    Closes-Bug: #1510990
    (cherry picked from commit eab4b15aeb1204989355705fe2ecdf184d8bbb8b)

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/openstack-ansible 12.0.8 release.

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/openstack-ansible 12.0.9 release.

[Doug Hellmann (doug-hellmann)]

This issue was fixed in the openstack/openstack-ansible 13.0.0 release.

[Davanum Srinivas (DIMS) (dims-v)]

This issue was fixed in the openstack/openstack-ansible 13.0.0 release.

[Davanum Srinivas (DIMS) (dims-v)]

This issue was fixed in the openstack/openstack-ansible 12.0.11 release.