User credentials not set, after running initial ansible-playbook on controller-0

[Peter Pikna]

Brief description
---------------------
I have problem with initialization of Starlingx system. I have tried to install All in one installation according to deployment guide in documentation. Unfortunatelly ansible-playbook failed at task "Delete old registry secrets in Barbican". After examination of log file (ansible.log) I noticed, that fail happened when it source /etc/platform/openrc file, where no OS_PASSWORD was set. Like "No password entered, or found via --os-password or OS_PASSWORD" error. Dont know if it is something essential but /var/log/fsmond.log file logging errors, that waiting to init completion.

Severity
---------------------
Critical

Steps to reproduce
---------------------
1. I set up minimal configuration in localhost.yml in HOME folder.
Configured parameters:

system_mode: simplex
dns_servers:
- 8.8.8.8
external_oam_subnet: ...
external_oam_gateway_address: ...
external_oam_floating_address: ...
admin_username: ...
admin_password: ...
ansible_become_pass: ...

2. Then I tried to copy default values file (default.yml) to localhost.yml with custom parameters above but this did not work too.

System configuration
---------------------
All in one simplex installation on XEN VM

Failed ansible tasks
#ansible.log
---------------------

TASK [bootstrap/persist-config : Delete old registry secrets in Barbican] *****************************************************************************************************************************************
task path: /usr/share/ansible/stx-ansible/playbooks/roles/bootstrap/persist-config/tasks/main.yml:109
<localhost> ESTABLISH LOCAL CONNECTION FOR USER: sysadmin
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091682.54-276406589248884 `" && echo ansible-tmp-1645091682.54-276406589248884="` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091682.54-276406589248884 `" ) && sleep 0'
Using module file /usr/lib/python2.7/site-packages/ansible/modules/commands/command.py
<localhost> PUT /home/sysadmin/.ansible/tmp/ansible-local-704315WX5DdM/tmpXwzj40 TO /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091682.54-276406589248884/AnsiballZ_command.py
<localhost> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091682.54-276406589248884/ /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091682.54-276406589248884/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c 'sudo -H -S -p "[sudo via ansible, key=pupjaqfurthxogbncslpiiaytqhqbjnx] password: " -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-pupjaqfurthxogbncslpiiaytqhqbjnx; /usr/bin/python /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091682.54-276406589248884/AnsiballZ_command.py'"'"' && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091682.54-276406589248884/ > /dev/null 2>&1 && sleep 0'
failed: [localhost] (item=Openstack Admin credentials can only be loaded from the active controller.) => {
    "changed": true,
    "cmd": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
    "delta": "0:00:00.897788",
    "end": "2022-02-17 09:54:43.575125",
    "invocation": {
        "module_args": {
            "_raw_params": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
            "_uses_shell": true,
            "argv": null,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "stdin": null,
            "warn": true
        }
    },
    "item": "Openstack Admin credentials can only be loaded from the active controller.",
    "msg": "non-zero return code",
    "rc": 1,
    "start": "2022-02-17 09:54:42.677337",
    "stderr": "No password entered, or found via --os-password or OS_PASSWORD",
    "stderr_lines": [
        "No password entered, or found via --os-password or OS_PASSWORD"
    ],
    "stdout": "Openstack Admin credentials can only be loaded from the active controller.",
    "stdout_lines": [
        "Openstack Admin credentials can only be loaded from the active controller."
    ]
}
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091683.61-263573409680800 `" && echo ansible-tmp-1645091683.61-263573409680800="` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091683.61-263573409680800 `" ) && sleep 0'
Using module file /usr/lib/python2.7/site-packages/ansible/modules/commands/command.py
<localhost> PUT /home/sysadmin/.ansible/tmp/ansible-local-704315WX5DdM/tmpyqmaOH TO /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091683.61-263573409680800/AnsiballZ_command.py
<localhost> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091683.61-263573409680800/ /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091683.61-263573409680800/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c 'sudo -H -S -p "[sudo via ansible, key=lpiryiubqpqygyblbohepiuquqmorskw] password: " -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-lpiryiubqpqygyblbohepiuquqmorskw; /usr/bin/python /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091683.61-263573409680800/AnsiballZ_command.py'"'"' && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091683.61-263573409680800/ > /dev/null 2>&1 && sleep 0'
failed: [localhost] (item=Openstack Admin credentials can only be loaded from the active controller.) => {
    "changed": true,
    "cmd": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
    "delta": "0:00:00.801855",
    "end": "2022-02-17 09:54:44.530658",
    "invocation": {
        "module_args": {
            "_raw_params": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
            "_uses_shell": true,
            "argv": null,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "stdin": null,
            "warn": true
        }
    },
    "item": "Openstack Admin credentials can only be loaded from the active controller.",
    "msg": "non-zero return code",
    "rc": 1,
    "start": "2022-02-17 09:54:43.728803",
    "stderr": "No password entered, or found via --os-password or OS_PASSWORD",
    "stderr_lines": [
        "No password entered, or found via --os-password or OS_PASSWORD"
    ],
    "stdout": "Openstack Admin credentials can only be loaded from the active controller.",
    "stdout_lines": [
        "Openstack Admin credentials can only be loaded from the active controller."
    ]
}
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091684.56-83907772048530 `" && echo ansible-tmp-1645091684.56-83907772048530="` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091684.56-83907772048530 `" ) && sleep 0'
Using module file /usr/lib/python2.7/site-packages/ansible/modules/commands/command.py
<localhost> PUT /home/sysadmin/.ansible/tmp/ansible-local-704315WX5DdM/tmpnb5mqf TO /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091684.56-83907772048530/AnsiballZ_command.py
<localhost> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091684.56-83907772048530/ /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091684.56-83907772048530/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c 'sudo -H -S -p "[sudo via ansible, key=vatrtkdeybazjtoldwfferuexawngqec] password: " -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-vatrtkdeybazjtoldwfferuexawngqec; /usr/bin/python /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091684.56-83907772048530/AnsiballZ_command.py'"'"' && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091684.56-83907772048530/ > /dev/null 2>&1 && sleep 0'
failed: [localhost] (item=Openstack Admin credentials can only be loaded from the active controller.) => {
    "changed": true,
    "cmd": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
    "delta": "0:00:00.840146",
    "end": "2022-02-17 09:54:45.527956",
    "invocation": {
        "module_args": {
            "_raw_params": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
            "_uses_shell": true,
            "argv": null,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "stdin": null,
            "warn": true
        }
    },
    "item": "Openstack Admin credentials can only be loaded from the active controller.",
    "msg": "non-zero return code",
    "rc": 1,
    "start": "2022-02-17 09:54:44.687810",
    "stderr": "No password entered, or found via --os-password or OS_PASSWORD",
    "stderr_lines": [
        "No password entered, or found via --os-password or OS_PASSWORD"
    ],
    "stdout": "Openstack Admin credentials can only be loaded from the active controller.",
    "stdout_lines": [
        "Openstack Admin credentials can only be loaded from the active controller."
    ]
}
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091685.56-86886941635601 `" && echo ansible-tmp-1645091685.56-86886941635601="` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091685.56-86886941635601 `" ) && sleep 0'
Using module file /usr/lib/python2.7/site-packages/ansible/modules/commands/command.py
<localhost> PUT /home/sysadmin/.ansible/tmp/ansible-local-704315WX5DdM/tmpiOyPWn TO /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091685.56-86886941635601/AnsiballZ_command.py
<localhost> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091685.56-86886941635601/ /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091685.56-86886941635601/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c 'sudo -H -S -p "[sudo via ansible, key=fwvtseukspvguulskstuslrbtcpqaxbp] password: " -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-fwvtseukspvguulskstuslrbtcpqaxbp; /usr/bin/python /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091685.56-86886941635601/AnsiballZ_command.py'"'"' && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091685.56-86886941635601/ > /dev/null 2>&1 && sleep 0'
failed: [localhost] (item=Openstack Admin credentials can only be loaded from the active controller.) => {
    "changed": true,
    "cmd": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
    "delta": "0:00:00.812724",
    "end": "2022-02-17 09:54:46.499730",
    "invocation": {
        "module_args": {
            "_raw_params": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
            "_uses_shell": true,
            "argv": null,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "stdin": null,
            "warn": true
        }
    },
    "item": "Openstack Admin credentials can only be loaded from the active controller.",
    "msg": "non-zero return code",
    "rc": 1,
    "start": "2022-02-17 09:54:45.687006",
    "stderr": "No password entered, or found via --os-password or OS_PASSWORD",
    "stderr_lines": [
        "No password entered, or found via --os-password or OS_PASSWORD"
    ],
    "stdout": "Openstack Admin credentials can only be loaded from the active controller.",
    "stdout_lines": [
        "Openstack Admin credentials can only be loaded from the active controller."
    ]
}
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091686.53-279272046050644 `" && echo ansible-tmp-1645091686.53-279272046050644="` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091686.53-279272046050644 `" ) && sleep 0'
Using module file /usr/lib/python2.7/site-packages/ansible/modules/commands/command.py
<localhost> PUT /home/sysadmin/.ansible/tmp/ansible-local-704315WX5DdM/tmp8bLJ8T TO /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091686.53-279272046050644/AnsiballZ_command.py
<localhost> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091686.53-279272046050644/ /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091686.53-279272046050644/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c 'sudo -H -S -p "[sudo via ansible, key=exxkcjtmmefgvppabqckztrorvhiqxdp] password: " -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-exxkcjtmmefgvppabqckztrorvhiqxdp; /usr/bin/python /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091686.53-279272046050644/AnsiballZ_command.py'"'"' && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091686.53-279272046050644/ > /dev/null 2>&1 && sleep 0'
failed: [localhost] (item=Openstack Admin credentials can only be loaded from the active controller.) => {
    "changed": true,
    "cmd": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
    "delta": "0:00:00.850181",
    "end": "2022-02-17 09:54:47.501918",
    "invocation": {
        "module_args": {
            "_raw_params": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
            "_uses_shell": true,
            "argv": null,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "stdin": null,
            "warn": true
        }
    },
    "item": "Openstack Admin credentials can only be loaded from the active controller.",
    "msg": "non-zero return code",
    "rc": 1,
    "start": "2022-02-17 09:54:46.651737",
    "stderr": "No password entered, or found via --os-password or OS_PASSWORD",
    "stderr_lines": [
        "No password entered, or found via --os-password or OS_PASSWORD"
    ],
    "stdout": "Openstack Admin credentials can only be loaded from the active controller.",
    "stdout_lines": [
        "Openstack Admin credentials can only be loaded from the active controller."
    ]
}
<localhost> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091687.53-257431168640717 `" && echo ansible-tmp-1645091687.53-257431168640717="` echo /tmp/.ansible-${USER}/tmp/ansible-tmp-1645091687.53-257431168640717 `" ) && sleep 0'
Using module file /usr/lib/python2.7/site-packages/ansible/modules/commands/command.py
<localhost> PUT /home/sysadmin/.ansible/tmp/ansible-local-704315WX5DdM/tmpF2Us0_ TO /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091687.53-257431168640717/AnsiballZ_command.py
<localhost> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091687.53-257431168640717/ /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091687.53-257431168640717/AnsiballZ_command.py && sleep 0'
<localhost> EXEC /bin/sh -c 'sudo -H -S -p "[sudo via ansible, key=xnwhunpxtaqddairgntwsqdkswkxjsub] password: " -u root /bin/sh -c '"'"'echo BECOME-SUCCESS-xnwhunpxtaqddairgntwsqdkswkxjsub; /usr/bin/python /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091687.53-257431168640717/AnsiballZ_command.py'"'"' && sleep 0'
<localhost> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-sysadmin/tmp/ansible-tmp-1645091687.53-257431168640717/ > /dev/null 2>&1 && sleep 0'
failed: [localhost] (item=Openstack Admin credentials can only be loaded from the active controller.) => {
    "changed": true,
    "cmd": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
    "delta": "0:00:00.848439",
    "end": "2022-02-17 09:54:48.501680",
    "invocation": {
        "module_args": {
            "_raw_params": "source /etc/platform/openrc; openstack secret delete Openstack Admin credentials can only be loaded from the active controller.",
            "_uses_shell": true,
            "argv": null,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "stdin": null,
            "warn": true
        }
    },
    "item": "Openstack Admin credentials can only be loaded from the active controller.",
    "msg": "non-zero return code",
    "rc": 1,
    "start": "2022-02-17 09:54:47.653241",
    "stderr": "No password entered, or found via --os-password or OS_PASSWORD",
    "stderr_lines": [
        "No password entered, or found via --os-password or OS_PASSWORD"
    ],
    "stdout": "Openstack Admin credentials can only be loaded from the active controller.",
    "stdout_lines": [
        "Openstack Admin credentials can only be loaded from the active controller."
    ]
}

PLAY RECAP ********************************************************************************************************************************************************************************************************
localhost : ok=144 changed=42 unreachable=0 failed=1

#/var/log/fsmond.log
...
2022-02-18T14:29:36.271 [3438.06467] localhost fsmond --- daemon_files.cpp (1036) daemon_wait_for_file : Warn : Waiting for /etc/platform/.initial_config_complete