AIO-SX Upgrade: Centos 22.06 to Centos 22.12 upgrade failed due to nginx failure

[Reinildes Oliveira]

Brief Description
--------------------------------------------------

Centos 22.06 to Centos 22.12 upgrade failed on AIO-SX due to ansible failure

Severity
--------------------------------------------------

Critical: System is not useable

Steps to Reproduce
--------------------------------------------------

1.Install 22.06 load AIO-SX system
2.Follow upgrade procedure to upgrade AIO-SX system to 22.12 centos load.

During the ansible execution, there was an error.

Expected Behavior
--------------------------------------------------

Ansible execution successful with no errors to continue the upgrade.

Actual Behavior
--------------------------------------------------
As the description says Centos 22.06 to Centos 22.12 upgrade failed on AIO-SX due to ansible failure as below .
2022-08-18 19:33:17,915 p=13415 u=sysadmin | fatal: [localhost]: FAILED! => changed=true
cmd: kubectl wait pod -n kube-system -l $(kubectl get service -n kube-system ic-nginx-ingress-ingress-nginx-controller-admission -o jsonpath="
{.spec.selector}

" | tr -d "{}\"" | tr ":" "=") --for=condition=Ready --timeout=60s
delta: '0:00:00.107273'
end: '2022-08-18 19:33:17.896974'
msg: non-zero return code
rc: 1
start: '2022-08-18 19:33:17.789701'
stderr: 'error: no matching resources found'
stderr_lines:

    'error: no matching resources found'
    stdout: ''
    stdout_lines: <omitted>

Reproducibility
--------------------------------------------------

3 of 3, 100%

System Configuration
--------------------------------------------------

AIO-SX system

Last Pass
--------------------------------------------------

8/11/2022

Timestamp/Logs
--------------------------------------------------

022-08-18 19:33:13,817 p=13415 u=sysadmin | Thursday 18 August 2022 19:33:13 +0000 (0:00:00.034) 0:14:21.496 *******
2022-08-18 19:33:14,001 p=13415 u=sysadmin | changed: [localhost]
2022-08-18 19:33:14,007 p=13415 u=sysadmin | TASK [common/armada-helm : If on system restore mode, kill ingress validating webhook pod so it can be recreated] ****************************************************************** **********************************************************************
2022-08-18 19:33:14,007 p=13415 u=sysadmin | Thursday 18 August 2022 19:33:14 +0000 (0:00:00.189) 0:14:21.686 *******
2022-08-18 19:33:17,655 p=13415 u=sysadmin | changed: [localhost]
2022-08-18 19:33:17,661 p=13415 u=sysadmin | TASK [common/armada-helm : Check ingress validating webhook service and pod status] ************************************************************************************************ **********************************************************************
2022-08-18 19:33:17,662 p=13415 u=sysadmin | Thursday 18 August 2022 19:33:17 +0000 (0:00:03.654) 0:14:25.341 *******
2022-08-18 19:33:17,915 p=13415 u=sysadmin | fatal: [localhost]: FAILED! => changed=true
cmd: kubectl wait pod -n kube-system -l $(kubectl get service -n kube-system ic-nginx-ingress-ingress-nginx-controller-admission -o jsonpath="\{.spec.selector}

" | tr -d "{}\"" | tr ":" "=") --for=condition=Ready --timeout=60s
delta: '0:00:00.107273'
end: '2022-08-18 19:33:17.896974'
msg: non-zero return code
rc: 1
start: '2022-08-18 19:33:17.789701'
stderr: 'error: no matching resources found'
stderr_lines:
 - 'error: no matching resources found'
stdout: ''
stdout_lines: <omitted>
2022-08-18 19:33:17,916 p=13415 u=sysadmin | PLAY RECAP ************************************************************************************************************************************************************************* **********************************************************************
2022-08-18 19:33:17,916 p=13415 u=sysadmin | localhost : ok=442 changed=227 unreachable=0 failed=1Alarm

Alarms
--------------------------------------------------
N/A

Test Activity
--------------------------------------------------
Regression

[Reinildes Oliveira (rjosemat)]

This was raised under the wrong project. I apologize.