Deployment with ceph and ansible 2.4 fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."

[Marius Cornea]

Deployment with ceph fails with: "WorkflowTasks_Step2_Execution: ERROR" "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'. Host key verification failed."

Digging through mistral logs I see:
onnect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}]}
2017-10-19 17:56:37,061 p=23479 u=mistral | failed: [192.168.24.12] (item=192.168.24.22) => {"item": "192.168.24.22", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}
2017-10-19 17:56:37,113 p=23479 u=mistral | failed: [192.168.24.12] (item=192.168.24.6) => {"item": "192.168.24.6", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}
2017-10-19 17:56:37,113 p=23479 u=mistral | fatal: [192.168.24.12]: UNREACHABLE! => {"changed": false, "msg": "All items completed", "results": [{"_ansible_item_result": true, "item": "192.168.24.11", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}, {"_ansible_item_result": true, "item": "192.168.24.12", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}, {"_ansible_item_result": true, "item": "192.168.24.9", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}, {"_ansible_item_result": true, "item": "192.168.24.21", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}, {"_ansible_item_result": true, "item": "192.168.24.16", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}, {"_ansible_item_result": true, "item": "192.168.24.18", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}, {"_ansible_item_result": true, "item": "192.168.24.22", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}, {"_ansible_item_result": true, "item": "192.168.24.6", "msg": "Failed to connect to the host via ssh: Could not create directory '/home/mistral/.ssh'.\r\nHost key verification failed.\r\n", "unreachable": true}]}

The issue seems to be caused in ansible 2.4 reported in https://github.com/ansible/ansible/issues/30720

[Marius Cornea (mcornea)]

Review in progress: https://review.openstack.org/#/c/513701/

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/pike
Review: https://review.openstack.org/514584

[wes hayutin (weshayutin)]

https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/0c1149a/undercloud/var/log/mistral/ceph-install-workflow.log.txt.gz#_2017-10-24_22_56_58_858

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/513701
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=09864037a7cdf149383d1c5ac5a8553b078d271a
Submitter: Zuul
Branch: master

commit 09864037a7cdf149383d1c5ac5a8553b078d271a
Author: Marius Cornea <email address hidden>
Date: Fri Oct 20 12:04:49 2017 +0200

    Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args

    ssh-common-args get ignored in ansible 2.4 due to
    https://github.com/ansible/ansible/issues/30720
    This change adds the use of ANSIBLE_HOST_KEY_CHECKING env var as
    a replacement for the ssh-common-args cli option.

    Closes-bug: 1725224

    Change-Id: I398e93d57f6155b59c3f049558558b3a18f4762c

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/514584
Committed: https://git.openstack.org/cgit/openstack/tripleo-common/commit/?id=6bef899ed13e0dcc5ba6a99bc1859fb77682bb4c
Submitter: Zuul
Branch: stable/pike

commit 6bef899ed13e0dcc5ba6a99bc1859fb77682bb4c
Author: Marius Cornea <email address hidden>
Date: Fri Oct 20 12:04:49 2017 +0200

    Use ANSIBLE_HOST_KEY_CHECKING var instead of ssh-common-args

    ssh-common-args get ignored in ansible 2.4 due to
    https://github.com/ansible/ansible/issues/30720
    This change adds the use of ANSIBLE_HOST_KEY_CHECKING env var as
    a replacement for the ssh-common-args cli option.

    Closes-bug: 1725224

    Change-Id: I398e93d57f6155b59c3f049558558b3a18f4762c
    (cherry picked from commit 87235537f791b99ba54a2d6ffd5c4d595e6d47c0)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-common 7.6.3 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-common 8.2.0 release.