Reported in https://bugzilla.redhat.com/show_bug.cgi?id=1803718
Overcloud update converge fails when updating Octavia to latest train
How reproducible: 100%
Steps to Reproduce:
1. Run OSP 16 update from GA to RHOS_TRUNK-16.0-RHEL-8-20200213.n.1 (z1 candidate)
2. The update will fail while executing "openstack overcloud update converge"
Actual results:
2020-02-16 18:52:22 | TASK [Configure octavia command] ***********************************************
2020-02-16 18:52:22 | Sunday 16 February 2020 18:49:53 +0000 (0:00:00.136) 0:27:36.744 *******
2020-02-16 18:52:22 | ok: [undercloud]
2020-02-16 18:52:22 |
2020-02-16 18:52:22 | TASK [set_fact] ****************************************************************
2020-02-16 18:52:22 | Sunday 16 February 2020 18:49:53 +0000 (0:00:00.137) 0:27:36.882 *******
2020-02-16 18:52:22 | ok: [undercloud]
2020-02-16 18:52:22 |
2020-02-16 18:52:22 | TASK [debug] *******************************************************************
2020-02-16 18:52:22 | Sunday 16 February 2020 18:49:53 +0000 (0:00:00.138) 0:27:37.020 *******
2020-02-16 18:52:22 | ok: [undercloud] => {
2020-02-16 18:52:22 | "msg": "Configure Octavia command is: ANSIBLE_CONFIG=\"/var/lib/mistral/overcloud/ansible.cfg\" ansible-playbook -i \"/var/lib/mistral/overcloud/octavia-ansible/inventory.yaml\" --extra-vars @/var/lib/mistral/overcloud/octavia-ansible/group_vars/octavia_vars.yaml --private-key /var/lib/mistral/overcloud/ssh_private_key /usr/share/ansible/tripleo-playbooks/octavia-files.yaml"
2020-02-16 18:52:22 | }
2020-02-16 18:52:22 |
2020-02-16 18:52:22 | TASK [Configure octavia on overcloud] ******************************************
2020-02-16 18:52:22 | Sunday 16 February 2020 18:49:53 +0000 (0:00:00.138) 0:27:37.159 *******
2020-02-16 18:52:22 | changed: [undercloud]
2020-02-16 18:52:25 |
2020-02-16 18:52:25 |
2020-02-16 18:52:25 | TASK [Purge temp dirs] *********************************************************
2020-02-16 18:52:25 | Sunday 16 February 2020 18:52:22 +0000 (0:02:28.703) 0:30:05.862 *******
2020-02-16 18:52:25 | failed: [undercloud] (item=/var/lib/mistral/overcloud/octavia-ansible/local_dir) => {"ansible_loop_var": "item", "changed": false, "item": "/var/lib/mistral/overcloud/octavia-ansible/local_dir", "msg": "rmtree failed: [Errno 13] Permission denied: '/var/lib/mistral/overcloud/octavia-ansible/local_dir'"}
2020-02-16 18:52:25 |
2020-02-16 18:52:25 | NO MORE HOSTS LEFT *************************************************************
2020-02-16 18:52:25 |
2020-02-16 18:52:25 | PLAY RECAP *********************************************************************
2020-02-16 18:52:25 | compute-0 : ok=256 changed=96 unreachable=0 failed=0 skipped=151 rescued=0 ignored=1
2020-02-16 18:52:25 | compute-1 : ok=252 changed=96 unreachable=0 failed=0 skipped=151 rescued=0 ignored=1
2020-02-16 18:52:25 | controller-0 : ok=347 changed=136 unreachable=0 failed=0 skipped=155 rescued=0 ignored=1
2020-02-16 18:52:25 | controller-1 : ok=299 changed=127 unreachable=0 failed=0 skipped=165 rescued=0 ignored=1
2020-02-16 18:52:25 | controller-2 : ok=299 changed=127 unreachable=0 failed=0 skipped=165 rescued=0 ignored=1
2020-02-16 18:52:25 | undercloud : ok=24 changed=10 unreachable=0 failed=1 skipped=64 rescued=0 ignored=0
2020-02-16 18:52:25 |
2020-02-16 18:52:25 | Sunday 16 February 2020 18:52:22 +0000 (0:00:00.376) 0:30:06.239 *******
2020-02-16 18:52:25 | ===============================================================================
2020-02-16 18:52:25 |
2020-02-16 18:52:25 | Ansible failed, check log at /var/lib/mistral/overcloud/ansible.log.
2020-02-16 18:52:25 | 2020-02-16 18:52:25.080 271008 ERROR openstack [-] Overcloud configuration failed.: tripleoclient.exceptions.DeploymentError: Overcloud configuration failed.ESC[00m
2020-02-16 18:52:25 | 2020-02-16 18:52:25.086 271008 INFO osc_lib.shell [-] END return value: 1ESC[00m
Fix proposed to branch: master
Review: https:/