Comment 0 for bug 2000080

Revision history for this message
Erickson Silva de Oliveira (esilvade) wrote : SX DM configure failed by platform-integ-apps apply-failed

Brief Description
-----------------
SX system installation failed by platform-integ-apps apply-failed

Severity
--------
Minor - Issue stopped the auto-installer from declaring a successful install. But the workaround os to re-apply platform-integ-apps

Steps to Reproduce
------------------
Install system

Expected Behavior
------------------
DM config platform-integ-apps success

Actual Behavior
----------------
DM config platform-integ-apps failed

Reproducibility
---------------
this is the first time saw this issue

System Configuration
--------------------
One node system

Branch/Pull Time/Commit
-----------------------

Timestamp/Logs
--------------
[2022-12-18 20:09:47,042] 541 DEBUG MainThread ssh.exec_cmd:: Running command: system --os-endpoint-type internalURL --os-region-name RegionOne application-list
[2022-12-18 20:09:47,042] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list'
[2022-12-18 20:09:47,093] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt
[2022-12-18 20:09:55,425] 473 DEBUG MainThread ssh.expect :: Output:
------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------

application version manifest name manifest file status progress
------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------

cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed
nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed
oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed
platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests applying retrieving docker images
------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------
[sysadmin@controller-0 ~(keystone_admin)]$
[2022-12-18 20:09:55,426] 351 DEBUG MainThread ssh.send :: Send 'echo $?'
[2022-12-18 20:09:55,478] 473 DEBUG MainThread ssh.expect :: Output:
0
[sysadmin@controller-0 ~(keystone_admin)]$
[2022-12-18 20:10:00,484] 534 DEBUG MainThread ssh.exec_cmd:: Executing command...
[2022-12-18 20:10:00,484] 541 DEBUG MainThread ssh.exec_cmd:: Running command: system --os-endpoint-type internalURL --os-region-name RegionOne application-list
[2022-12-18 20:10:00,484] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list'
[2022-12-18 20:10:00,534] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt
[2022-12-18 20:10:09,264] 473 DEBUG MainThread ssh.expect :: Output:
------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}----------------------------------------------------------------------------

application version manifest name manifest file status progress
------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}----------------------------------------------------------------------------

cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed
nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed
oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed
platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests apply-failed Unexpected process termination while application-apply was in progress. The
          application status has changed from 'applying' to 'apply-failed'.

------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}----------------------------------------------------------------------------
[sysadmin@controller-0 ~(keystone_admin)]$

[2022-12-18 20:10:00,484] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list'
[2022-12-18 20:10:00,534] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt
[2022-12-18 20:10:09,264] 473 DEBUG MainThread ssh.expect :: Output:
------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}----------------------------------------------------------------------------

application version manifest name manifest file status progress
------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}----------------------------------------------------------------------------

cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed
nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed
oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed
platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests apply-failed Unexpected process termination while application-apply was in progress. The
          application status has changed from 'applying' to 'apply-failed'.

------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}----------------------------------------------------------------------------
[sysadmin@controller-0 ~(keystone_admin)]$

Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fb6677e3bb5854c537a578d135dfa0627a399bb3d85278065584b8ea677e69ec": plugin type="multus" name="multus-cni-network" failed (add): Multus: [platform-deployment-manager/platform-deployment-manager-699b9bb75b-gj7xp/]: error getting pod: Get "https://[10.96.0.1]:443/api/v1/namespaces/platform-deployment-manager/pods/platform-deployment-manager-699b9bb75b-gj7xp?timeout=1m0s": dial tcp 10.96.0.1:443: connect: no route to host

Test Activity
-------------
installation

Workaround
-------------
Run the system application-apply platform-integ-apps command manually and it passes