Subcloud remote restore failed - 3 incorrect password attempt

[Virginia Martins Perozim]

Brief Description
-----------------
Remote Restore of redfish enabled subclouds failed due to incorrect password attempt during ansible restore initial config check of

Severity
--------
Major: Unable to restore subcloud

Steps to Reproduce
------------------
1. Execute subcloud locally in subcloud1
2. scp files to system controller /home/sysadmin/subcloud1
3. unmanage subcloud1
4. Execute remote restore from system controller:

Expected Behavior
------------------
Restore successful

Actual Behavior
----------------
Failed to restore subcloud

Reproducibility
---------------
100%

System Configuration
--------------------
WRO_DEVANDTEST-DC2/subcloud1

SW_VERSION="22.06"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="2022-06-25_02-46-51"
SRC_BUILD_ID="14"

JOB="WRCP_22.06_Build"
BUILD_BY="jenkins"
BUILD_NUMBER="14"
BUILD_HOST="yow-cgts4-lx.wrs.com"
BUILD_DATE="2022-06-25 02:49:38 -0400"

Branch/Pull Time/Commit
-----------------------
Branch Master

Last Pass
---------
-

Timestamp/Logs
--------------

TASK [restore-platform/prepare-env : Set restore kubernetes version for bootstrap] ***
Thursday 15 September 2022 11:29:09 +0000 (0:00:00.021) 0:00:04.057 ****
ok: [subcloud1 -> localhost]

TASK [restore-platform/prepare-env : debug] ************************************
Thursday 15 September 2022 11:29:09 +0000 (0:00:00.029) 0:00:04.087 ****
ok: [subcloud1 -> localhost] =>
  msg: kubeadm version from kube_cmd_versions 1.23.1

TASK [restore-platform/prepare-env : Check initial config flag] ****************
Thursday 15 September 2022 11:29:09 +0000 (0:00:00.022) 0:00:04.110 ****
fatal: [subcloud1]: FAILED! => changed=false
  module_stderr: |-
    Shared connection to 2620:10a:a001:d41::173 closed.
  module_stdout: |-
    Sorry, try again.
    Sorry, try again.
    sudo: 3 incorrect password attempts
  msg: |-
    MODULE FAILURE
    See stdout/stderr for the exact error
  rc: 1

PLAY RECAP *********************************************************************
subcloud1 : ok=19 changed=6 unreachable=0 failed=1

Test Activity
-------------
B&R Testing

Workaround
----------
-

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/ansible-playbooks/+/857979

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/distcloud/+/859445

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Virginia Martins Perozim <email address hidden>" on branch: master
Review: https://review.opendev.org/c/starlingx/ansible-playbooks/+/857979
Reason: moving the solution to other repository

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Virginia Martins Perozim <email address hidden>" on branch: master
Review: https://review.opendev.org/c/starlingx/distcloud/+/859445
Reason: solution in other repository

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/ansible-playbooks/+/857979
Committed: https://opendev.org/starlingx/ansible-playbooks/commit/8ea7aa795b584ceab148851406be6909d9716e4d
Submitter: "Zuul (22348)"
Branch: master

commit 8ea7aa795b584ceab148851406be6909d9716e4d
Author: Virginia Martins Perozim <email address hidden>
Date: Thu Sep 15 16:53:54 2022 -0400

    Wait connection before check initial config flag

    Remote restore is failing when try to connect to subcloud with root
    user during the task "Check initial config flag".
    The solution is to wait some seconds for connection before execute
    the block that needs root user credentials when access subcloud.

    Test Plan:

    PASSED: DC - subcloud B&R from system controller

    Closes-Bug: 1989802
    Signed-off-by: Virginia Martins Perozim <email address hidden>
    Change-Id: I3cc19e2ce3d8e00c97ef5995fe61da8bc845af57