kolla mariadb_recovery faild

[Gavin]

I run a 3 control node of kolla

when i try to use command "kolla-ansible mariadb_recovery -i multinode" to recovery the mariadb.

it report error like blow:

TASK [mariadb : Starting first MariaDB container] ******************************
skipping: [kollasvr1]
skipping: [kollasvr3]
fatal: [kollasvr2]: FAILED! => {"changed": true, "failed": true, "msg": "'Traceback (most recent call last):\\n File \"/tmp/ansible_DeuD2g/ansible_module_kolla_docker.py\", line 781, in main\\n result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n File \"/tmp/ansible_DeuD2g/ansible_module_kolla_docker.py\", line 595, in start_container\\n self.pull_image()\\n File \"/tmp/ansible_DeuD2g/ansible_module_kolla_docker.py\", line 445, in pull_image\\n repository=image, tag=tag, stream=True\\n File \"/usr/lib/python2.7/site-packages/docker/api/image.py\", line 180, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python2.7/site-packages/docker/client.py\", line 173, in _raise_for_status\\n raise errors.NotFound(e, response, explanation=explanation)\\nNotFound: 404 Client Error: Not Found (\"{\"message\":\"manifest for kolla/centos-source-mariadb:auto not found\"}\")\\n'"}

TASK [mariadb : Reset bootstrap fact] ******************************************
ok: [kollasvr1]
ok: [kollasvr3]

TASK [mariadb : include] *******************************************************
included: /usr/share/kolla-ansible/ansible/roles/mariadb/tasks/start.yml for kollasvr1, kollasvr3

TASK [mariadb : Starting mariadb container] ************************************
fatal: [kollasvr3]: FAILED! => {"changed": true, "failed": true, "msg": "'Traceback (most recent call last):\\n File \"/tmp/ansible_rZE_QY/ansible_module_kolla_docker.py\", line 781, in main\\n result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n File \"/tmp/ansible_rZE_QY/ansible_module_kolla_docker.py\", line 595, in start_container\\n self.pull_image()\\n File \"/tmp/ansible_rZE_QY/ansible_module_kolla_docker.py\", line 445, in pull_image\\n repository=image, tag=tag, stream=True\\n File \"/usr/lib/python2.7/site-packages/docker/api/image.py\", line 180, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python2.7/site-packages/docker/client.py\", line 173, in _raise_for_status\\n raise errors.NotFound(e, response, explanation=explanation)\\nNotFound: 404 Client Error: Not Found (\"{\"message\":\"manifest for kolla/centos-source-mariadb:auto not found\"}\")\\n'"}
fatal: [kollasvr1]: FAILED! => {"changed": true, "failed": true, "msg": "'Traceback (most recent call last):\\n File \"/tmp/ansible_0j9Eza/ansible_module_kolla_docker.py\", line 781, in main\\n result = bool(getattr(dw, module.params.get(\\'action\\'))())\\n File \"/tmp/ansible_0j9Eza/ansible_module_kolla_docker.py\", line 595, in start_container\\n self.pull_image()\\n File \"/tmp/ansible_0j9Eza/ansible_module_kolla_docker.py\", line 445, in pull_image\\n repository=image, tag=tag, stream=True\\n File \"/usr/lib/python2.7/site-packages/docker/api/image.py\", line 180, in pull\\n self._raise_for_status(response)\\n File \"/usr/lib/python2.7/site-packages/docker/client.py\", line 173, in _raise_for_status\\n raise errors.NotFound(e, response, explanation=explanation)\\nNotFound: 404 Client Error: Not Found (\"{\"message\":\"manifest for kolla/centos-source-mariadb:auto not found\"}\")\\n'"}
 to retry, use: --limit @/usr/share/kolla-ansible/ansible/mariadb_recovery.retry

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/455505
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=f9899fbfc137cc37cffeab857d8e2c325ca67821
Submitter: Jenkins
Branch: master

commit f9899fbfc137cc37cffeab857d8e2c325ca67821
Author: Jeffrey Zhang <email address hidden>
Date: Tue Apr 11 12:08:29 2017 +0800

    Detect openstack_release variable in mariadb recovery playbooks

    Change-Id: Icb9b097299011cc09f3012bbee9629a5457c920c
    Closes-Bug: #1681316

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/457145

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/457145
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=0e1750b1ffb2ba9271507e2b1ed4c92e2c3aeb35
Submitter: Jenkins
Branch: stable/ocata

commit 0e1750b1ffb2ba9271507e2b1ed4c92e2c3aeb35
Author: Jeffrey Zhang <email address hidden>
Date: Tue Apr 11 12:08:29 2017 +0800

    Detect openstack_release variable in mariadb recovery playbooks

    Change-Id: Icb9b097299011cc09f3012bbee9629a5457c920c
    Closes-Bug: #1681316
    (cherry picked from commit f9899fbfc137cc37cffeab857d8e2c325ca67821)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 4.0.1 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 5.0.0.0b2 development milestone.