magnum deploy failing

[Dave Walker]

TASK [magnum : include] ********************************************************
included: /usr/share/kolla/ansible/roles/magnum/tasks/deploy.yml for amcvc-nb160051, amcvc-nb160052, amcvc-nb160053

TASK [magnum : include] ********************************************************
included: /usr/share/kolla/ansible/roles/magnum/tasks/register.yml for amcvc-nb160051, amcvc-nb160052, amcvc-nb160053

TASK [magnum : Creating the Magnum service and endpoint] ***********************
changed: [amcvc-nb160051] => (item={u'interface': u'admin', u'url': u'http://<REDACTED>:9511/v1'})
changed: [amcvc-nb160051] => (item={u'interface': u'internal', u'url': u'http://<REDACTED>:9511/v1'})
changed: [amcvc-nb160051] => (item={u'interface': u'public', u'url': u'http://<REDACTED>:9511/v1'})

TASK [magnum : Creating the Magnum project, user, and role] ********************
changed: [amcvc-nb160051]

TASK [magnum : Creating Magnum trustee domain] *********************************
changed: [amcvc-nb160051]

TASK [magnum : Setting Magnum trustee domain value] ****************************
ok: [amcvc-nb160051]
ok: [amcvc-nb160052]
ok: [amcvc-nb160053]

TASK [magnum : Creating Magnum trustee user] ***********************************
changed: [amcvc-nb160051]

TASK [magnum : Setting Magnum trustee user value] ******************************
ok: [amcvc-nb160051]
ok: [amcvc-nb160052]
ok: [amcvc-nb160053]

TASK [magnum : Creating Magnum trustee user role] ******************************
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (9 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (8 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (7 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (6 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (5 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (4 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (3 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (2 retries left).
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (1 retries left).
fatal: [amcvc-nb160051]: FAILED! => {"changed": false, "cmd": ["docker", "exec", "-t", "kolla_toolbox", "/usr/bin/ansible", "localhost", "-m", "os_user_role", "-a", "domain=f230c5b380824a799319e19130453521 user=b43ed8d94a1448e1ad876b2188d636c0 role=admin auth={{ openstack_magnum_auth }}", "-e", "{'openstack_magnum_auth':{'username': 'admin', 'project_name': 'admin', 'password': 'KROgJtFbN4aLo57Pg3RzsYKaNIKPUXiF36RUXfpb', 'auth_url': 'http://<REDACTED>:35357'}}"], "delta": "0:00:02.475671", "end": "2016-10-05 17:17:11.315805", "failed": true, "rc": 1, "start": "2016-10-05 17:17:08.840134", "stderr": "", "stdout": "localhost | FAILED! => {\r\n \"changed\": false, \r\n \"failed\": true, \r\n \"msg\": \"User b43ed8d94a1448e1ad876b2188d636c0 is not valid\"\r\n}", "stdout_lines": ["localhost | FAILED! => {", " \"changed\": false, ", " \"failed\": true, ", " \"msg\": \"User b43ed8d94a1448e1ad876b2188d636c0 is not valid\"", "}"], "warnings": []}
 [ERROR]: Could not create retry file '/usr/share/kolla/ansible/site.retry'. The error was: [Errno 13] Permission denied: '/usr/share/kolla/ansible/site.retry'

[Martin Matyáš (martinx-maty)]

Is that error happening during deployment to a clean nodes or a repeated deployment?

Please provide:
- inventory file
- globals.yml
- content of your /etc/kolla/config if any
- run again deployment with "-v -v -v", get logs
- after failure, set OS authentication environment variables and get results of:
     openstack user list --long
     openstack domain list
     openstack role list

[Steven Dake (sdake)]

Daviey,

Any chance you could provide the information requested? Marmat is doing the magnum implementation in Kolla.

[zhubingbing (zhubingbing)]

i reproduce this bug

centos source all-in-one

[zhubingbing (zhubingbing)]

ASK [magnum : Creating Magnum trustee user role] ******************************
task path: /usr/share/kolla/ansible/roles/magnum/tasks/register.yml:75
<localhost> ESTABLISH LOCAL CONNECTION FOR USER: root
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo $HOME/.ansible/tmp/ansible-tmp-1476177792.4-243574607737858 `" && echo ansible-tmp-1476177792.4-243574607737858="` echo $HOME/.ansible/tmp/ansible-tmp-1476177792.4-243574607737858 `" ) && sleep 0'
<localhost> PUT /tmp/tmpTa2eVV TO /root/.ansible/tmp/ansible-tmp-1476177792.4-243574607737858/command
<localhost> EXEC /bin/sh -c 'chmod u+x /root/.ansible/tmp/ansible-tmp-1476177792.4-243574607737858/ /root/.ansible/tmp/ansible-tmp-1476177792.4-243574607737858/command && sleep 0'
<localhost> EXEC /bin/sh -c 'LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8 /usr/bin/python /root/.ansible/tmp/ansible-tmp-1476177792.4-243574607737858/command; rm -rf "/root/.ansible/tmp/ansible-tmp-1476177792.4-243574607737858/" > /dev/null 2>&1 && sleep 0'
FAILED - RETRYING: TASK: magnum : Creating Magnum trustee user role (10 retries left).Result was: {"attempts": 1, "changed": false, "cmd": ["docker", "exec", "-t", "kolla_toolbox", "/usr/bin/ansible", "localhost", "-m", "os_user_role", "-a", "domain=39d6b059d8d7431c9629c11cb514f419 user=magnum_trustee_domain_admin role=admin auth={{ openstack_magnum_auth }}", "-e", "{'openstack_magnum_auth':{'username': 'admin', 'project_name': 'admin', 'password': 'yI2MnMSHSwk6auqZ4cMvl0Z6zG9uHDdH4skAtkqm', 'auth_url': 'http://192.168.23.251:35357'}}"], "delta": "0:00:01.348780", "end": "2016-10-11 09:23:13.887184", "failed": true, "invocation": {"module_args": {"_raw_params": "docker exec -t kolla_toolbox /usr/bin/ansible localhost -m os_user_role -a \"domain=39d6b059d8d7431c9629c11cb514f419 user=magnum_trustee_domain_admin role=admin auth={{ openstack_magnum_auth }}\" -e \"{'openstack_magnum_auth':{'username': 'admin', 'project_name': 'admin', 'password': 'yI2MnMSHSwk6auqZ4cMvl0Z6zG9uHDdH4skAtkqm', 'auth_url': 'http://192.168.23.251:35357'}}\"", "_uses_shell": false, "chdir": null, "creates": null, "executable": null, "removes": null, "warn": true}, "module_name": "command"}, "rc": 1, "retries": 11, "start": "2016-10-11 09:23:12.538404", "stderr": "", "stdout": "localhost | FAILED! => {\r\n \"changed\": false, \r\n \"failed\": true, \r\n \"msg\": \"shade 1.5.0 or higher is required for this module\"\r\n}", "stdout_lines": ["localhost | FAILED! => {", " \"changed\": false, ", " \"failed\": true, ", " \"msg\": \"shade 1.5.0 or higher is required for this module\"", "}"], "warnings": []}
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo $HOME/.ansible/tmp/ansible-tmp-1476177798.92-34725433608141 `" && echo ansible-tmp-1476177798.92-34725433608141="` echo $HOME/.ansible/tmp/ansible-tmp-1476177798.92-34725433608141 `" ) && sleep 0'
<localhost> PUT /tmp/tmpgt2eAI TO /root/.ansible/tmp/ansible-tmp-1476177798.92-34725433608141/command
<localhost> EXEC /bin/sh -c 'chmod u+x /root/.ansible/tmp/ansible-tmp-1476177798.92-34725433608141/ /root/.ansible/tmp/ansible-tmp-1476177798.92-34725433608141/command && sleep 0'
<localhost> EXEC /bin/sh -c ...

[zhubingbing (zhubingbing)]

hi Dave Walker ,
you can kolla-build magnum the laster version;

https://github.com/openstack/kolla/blob/master/docker/kolla-toolbox/Dockerfile.j2#L60

[zhubingbing (zhubingbing)]

sorry, you can kolla-build kolla-toolbox

[Martin Matyáš (martinx-maty)]

zhubingbing, I believe your issue with old version of toolbox is different from what was originally reported, error message is not the same.