Octavia install fails with octavia-ansible not writable

[Carlos Goncalves]

Child directories of /var/lib/mistral/overcloud/octavia-ansible are created and set with correct user ownership (ansible user) but not their parent directory "octavia-ansible".

Thanks to IRC user "triple-oh-noob" (aren't we all?! :D) for the report!

TASK [Delete param file] *******************************************************
Thursday 10 October 2019 01:47:41 +0000 (0:00:00.182) 1:26:04.801 ******
skipping: [undercloud] => {"changed": false, "skip_reason": "Conditional result was False"}

TASK [Delete role file] ********************************************************
Thursday 10 October 2019 01:47:41 +0000 (0:00:00.157) 1:26:04.958 ******
skipping: [undercloud] => {"changed": false, "skip_reason": "Conditional result was False"}

TASK [Set up group_vars] *******************************************************
Thursday 10 October 2019 01:47:41 +0000 (0:00:00.159) 1:26:05.117 ******
ok: [undercloud] => {"ansible_facts": {"octavia_ansible_group_vars": {"amp_image_filename": "", "amp_image_name": "", "amp_image_tag": "amphora-image", "amp_ssh_key_data": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAAgQD3bBwuxHj5vHRnmle4HZj2AC82khktvhZJ9yS2LllUYaH792Pi3YEiFRS2
55eBwiIiOchJvdUC3n5CfV2xSg1+efS6C5nYNXTuqYbiKXc+oij+eQTQTYlQyNIugJQRtXYJBikpe4zj9p0QGT9KIm2oF134TvXCkvVfFNYeg98skw== <email address hidden>\n", "amp_ssh_key_name": "octavia-ssh-key", "amp_ssh_key_path": "", "amp_to_raw": true, "auth_password": "ZJaNTKR8M4T6g1Sfuh
C9tusL1", "auth_project_name": "service", "auth_username": "octavia", "ca_cert_path": "/etc/octavia/certs/ca_01.pem", "ca_passphrase": "zE1YCpLrDB8g4fkYoVT5IHLyr", "ca_private_key_path": "/etc/octavia/certs/private/cakey.pem", "client_cert_path": "/etc/octavia/certs/cl
ient.pem", "container_cli": "docker", "generate_certs": true, "lb_mgmt_net_name": "lb-mgmt-net", "lb_mgmt_subnet_cidr": "172.24.0.0/16", "lb_mgmt_subnet_gateway": "172.24.0.1", "lb_mgmt_subnet_name": "lb-mgmt-subnet", "lb_mgmt_subnet_pool_end": "172.24.255.254", "lb_mg
mt_subnet_pool_start": "172.24.0.2", "lb_sec_group_name": "lb-mgmt-subnet", "mgmt_port_dev": "o-hm0", "octavia_ansible_playbook": "/usr/share/tripleo-common/playbooks/octavia-files.yaml", "octavia_group_vars_dir": "/var/lib/mistral/overcloud/octavia-ansible/group_vars"
, "octavia_local_tmpdir": "/var/lib/mistral/overcloud/octavia-ansible/local_dir", "os_auth_type": "password", "os_auth_url": "http://10.211.242.180:5000/v3", "os_identity_api_version": "3", "os_password": "Gammalab123!", "os_project_name": "admin", "os_username": "admi
n", "server_certs_key_passphrase": "FCUiBNrSBI4hMpLSzSIbEj6wM8ZcHxRN"}}, "changed": false}

TASK [Make needed directories on the undercloud] *******************************
Thursday 10 October 2019 01:47:42 +0000 (0:00:00.180) 1:26:05.297 ******
ok: [undercloud] => (item=/var/lib/mistral/overcloud/octavia-ansible/local_dir) => {"ansible_loop_var": "item", "changed": false, "gid": 42430, "group": "42430", "item": "/var/lib/mistral/overcloud/octavia-ansible/local_dir", "mode": "0755", "owner": "tripleo-admin", "
path": "/var/lib/mistral/overcloud/octavia-ansible/local_dir", "secontext": "system_u:object_r:container_file_t:s0", "size": 6, "state": "directory", "uid": 1002}
ok: [undercloud] => (item=/var/lib/mistral/overcloud/octavia-ansible/group_vars) => {"ansible_loop_var": "item", "changed": false, "gid": 42430, "group": "42430", "item": "/var/lib/mistral/overcloud/octavia-ansible/group_vars", "mode": "0755", "owner": "tripleo-admin",
 "path": "/var/lib/mistral/overcloud/octavia-ansible/group_vars", "secontext": "system_u:object_r:container_file_t:s0", "size": 31, "state": "directory", "uid": 1002}

TASK [Write group_vars file] ***************************************************
Thursday 10 October 2019 01:47:43 +0000 (0:00:01.361) 1:26:06.659 ******
changed: [undercloud] => {"changed": true, "checksum": "e5f750489441a5ad60a58743ba4811c23e579250", "dest": "/var/lib/mistral/overcloud/octavia-ansible/group_vars/octavia_vars.yaml", "gid": 1003, "group": "tripleo-admin", "md5sum": "a7aefff0c2cbe47435977b329736825f", "m
ode": "0664", "owner": "tripleo-admin", "secontext": "system_u:object_r:container_file_t:s0", "size": 1467, "src": "/tmp/ansible-tripleo-admin/ansible-tmp-1570672063.6-119404134580715/source", "state": "file", "uid": 1002}

TASK [Write octavia inventory] *************************************************
Thursday 10 October 2019 01:47:44 +0000 (0:00:01.050) 1:26:07.710 ******
fatal: [undercloud]: FAILED! => {"changed": false, "checksum": "975e4511f72ef8c965037099a8706ad4860fb663", "msg": "Destination /var/lib/mistral/overcloud/octavia-ansible not writable"}

NO MORE HOSTS LEFT *************************************************************

PLAY RECAP *********************************************************************
overcloud-cephstorage-0 : ok=154 changed=66 unreachable=0 failed=0 skipped=672 rescued=0 ignored=0
overcloud-cephstorage-1 : ok=155 changed=66 unreachable=0 failed=0 skipped=672 rescued=0 ignored=0
overcloud-cephstorage-2 : ok=154 changed=66 unreachable=0 failed=0 skipped=672 rescued=0 ignored=0
overcloud-controller-0 : ok=251 changed=152 unreachable=0 failed=0 skipped=575 rescued=0 ignored=0
overcloud-controller-1 : ok=244 changed=150 unreachable=0 failed=0 skipped=583 rescued=0 ignored=0
overcloud-controller-2 : ok=243 changed=150 unreachable=0 failed=0 skipped=583 rescued=0 ignored=0
overcloud-novacompute-0 : ok=186 changed=91 unreachable=0 failed=0 skipped=640 rescued=0 ignored=0
overcloud-novacompute-1 : ok=186 changed=91 unreachable=0 failed=0 skipped=640 rescued=0 ignored=0
overcloud-novacompute-2 : ok=186 changed=91 unreachable=0 failed=0 skipped=640 rescued=0 ignored=0
overcloud-novacompute-3 : ok=187 changed=91 unreachable=0 failed=0 skipped=640 rescued=0 ignored=0
undercloud : ok=48 changed=21 unreachable=0 failed=1 skipped=248 rescued=0 ignored=0

Thursday 10 October 2019 01:47:46 +0000 (0:00:02.300) 1:26:10.011 ******
===============================================================================

Ansible failed, check log at /var/lib/mistral/overcloud/ansible.log.
Overcloud configuration failed.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/687839
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=0c638605e8a45bee92d70123ffbafd9c685f5c03
Submitter: Zuul
Branch: master

commit 0c638605e8a45bee92d70123ffbafd9c685f5c03
Author: Carlos Goncalves <email address hidden>
Date: Thu Oct 10 11:29:19 2019 +0200

    Set octavia-ansible dir ownership to Ansible user

    Closes-Bug: #1847608
    Change-Id: I840bfe1cb932810a787b1a4f84b79a298da01e8c

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 12.0.0 release.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/train
Review: https://review.opendev.org/708645

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/708646

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/708645
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=ed158f786432e6a8a60f3da22ae282ec4da9d466
Submitter: Zuul
Branch: stable/train

commit ed158f786432e6a8a60f3da22ae282ec4da9d466
Author: Carlos Goncalves <email address hidden>
Date: Thu Oct 10 11:29:19 2019 +0200

    Set octavia-ansible dir ownership to Ansible user

    Closes-Bug: #1847608
    Change-Id: I840bfe1cb932810a787b1a4f84b79a298da01e8c
    (cherry picked from commit 0c638605e8a45bee92d70123ffbafd9c685f5c03)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/708646
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=f0dda8552dcfd0d6a1adf02da36b2076692a5899
Submitter: Zuul
Branch: stable/stein

commit f0dda8552dcfd0d6a1adf02da36b2076692a5899
Author: Carlos Goncalves <email address hidden>
Date: Thu Oct 10 11:29:19 2019 +0200

    Set octavia-ansible dir ownership to Ansible user

    Closes-Bug: #1847608
    Change-Id: I840bfe1cb932810a787b1a4f84b79a298da01e8c
    (cherry picked from commit 0c638605e8a45bee92d70123ffbafd9c685f5c03)
    (cherry picked from commit ed158f786432e6a8a60f3da22ae282ec4da9d466)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 11.4.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates stein-eol release.