devmode.sh --ovb fails to deploy overcloud

[Derek Higgins]

While running devmode.sh the overcloud consistently fails to deploy

$ ./devmode.sh --ovb --no-gate
<snip/>
+ ansible-playbook -vv /root/.quickstart/playbooks/baremetal-full-deploy.yml -e @/root/.quickstart/config/release/master-tripleo-ci.yml -e @/root/.quickstart/config/nodes/1ctlr_1comp.yml -e @/root/.quickstart/config/general_config/ovb-minimal-pacemaker-public-bond.yml -e @/root/.quickstart/config/environments/rdocloud.yml -e local_working_dir=/root/.quickstart -e virthost=localhost -e @/root/.quickstart/config/environments/ovb-common.yml -e cleanup_stacks_keypairs=false -t all,teardown-nodes
<snip/>

TASK [overcloud-deploy : Run the deployed-server_prepare script] **************************************************************************************************************************************************
task path: /root/.quickstart/usr/local/share/ansible/roles/overcloud-deploy/tasks/deployed-server.yml:9
Thursday 12 April 2018 23:34:02 +0000 (0:00:00.093) 1:31:02.618 ********
skipping: [undercloud] => {"changed": false, "skip_reason": "Conditional result was False", "skipped": true}

TASK [overcloud-deploy : Deploy the overcloud] ********************************************************************************************************************************************************************
task path: /root/.quickstart/usr/local/share/ansible/roles/overcloud-deploy/tasks/deploy-overcloud.yml:1
Thursday 12 April 2018 23:34:02 +0000 (0:00:00.123) 1:31:02.741 ********

<38.145.33.136> ssh_retry: attempt: 0, ssh return code is 255. cmd (['ssh', '-F', '/root/.quickstart/ssh.config.ansible', '-o', 'StrictHostKeyChecking=no', '-o', 'IdentityFile="/root/.quickstart/id_rsa_undercloud"', '-o', 'KbdInteractiveAuthentication=no', '-o', 'PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey', '-o', 'PasswordAuthentication=no', '-o', 'User=stack', '-o', 'ConnectTimeout=10', '-F', '/root/.quickstart/ssh.config.local.ansible', '-tt', '38.145.33.136', '/bin/sh -c \'/usr/bin/python /home/stack/.ansible/tmp/ansible-tmp-1523576042.26-181411050169806/command.py; rm -rf "/home/stack/.ansible/tmp/ansible-tmp-1523576042.26-181411050169806/" > /dev/null 2>&1 && sleep 0\'']...), pausing for 0 seconds
fatal: [undercloud]: FAILED! => {"changed": false, "failed": true, "module_stderr": "Connection to 38.145.33.136 closed.\r\n", "module_stdout": "/usr/bin/python: can't open file '/home/stack/.ansible/tmp/ansible-tmp-1523576042.26-181411050169806/command.py': [Errno 2] No such file or directory\r\n", "msg": "MODULE FAILURE", "rc": 0}
...ignoring

The undercloud installs, when the heat stack gets created the controller and compute nodes successfully comes up but after that everything times out

[Derek Higgins (derekh)]

Attaching overcloud_deploy.log

[Sagi (Sergey) Shnaidman (sshnaidm)]

Derek, it seems like network issue in the cloud tenant. Is it always reproducible?

[Derek Higgins (derekh)]

> Derek, it seems like network issue in the cloud tenant. Is it always reproducible?

It was consistently reproducible when I filed the bug, I haven't tried it since. I don't think it was a problem with rdo-cloud as I was able to manually deploy a overcloud using the undercloud that quickstart created, So I suspected the combination of heat templates being used by devmode don't work together.

I can't try it out at the moment as my cloud resources are tied up.

[Derek Higgins (derekh)]

I Guess this can be closed as devmode.sh is no longer supported