StarlingX

  1. Bug #2000080
  2. Activity log

Activity log for bug #2000080

Date Who What changed Old value New value Message
2022-12-19 17:43:21 Erickson Silva de Oliveira bug added bug
2022-12-19 17:58:19 OpenStack Infra starlingx: status New In Progress
2023-01-16 14:34:04 Ghada Khalil summary SX DM configure failed by platform-integ-apps apply-failed SX configure failed by platform-integ-apps apply-failed
2023-01-16 14:34:19 Ghada Khalil tags stx.apps
2023-01-25 15:49:37 OpenStack Infra starlingx: status In Progress Fix Released
2023-01-27 01:51:11 Ghada Khalil starlingx: importance Undecided Low
2023-01-27 01:51:35 Ghada Khalil tags stx.apps stx.8.0 stx.apps
2023-01-27 01:51:51 Ghada Khalil starlingx: assignee Erickson Silva de Oliveira (esilvade)
2023-01-27 02:54:04 Ghada Khalil starlingx: importance Low Medium
2023-01-27 02:54:21 Ghada Khalil description Brief Description ----------------- SX system installation failed by platform-integ-apps apply-failed Severity -------- Minor - Issue stopped the auto-installer from declaring a successful install. But the workaround os to re-apply platform-integ-apps Steps to Reproduce ------------------ Install system Expected Behavior ------------------ DM config platform-integ-apps success Actual Behavior ---------------- DM config platform-integ-apps failed Reproducibility --------------- this is the first time saw this issue System Configuration -------------------- One node system Branch/Pull Time/Commit ----------------------- Timestamp/Logs -------------- [2022-12-18 20:09:47,042] 541 DEBUG MainThread ssh.exec_cmd:: Running command: system --os-endpoint-type internalURL --os-region-name RegionOne application-list [2022-12-18 20:09:47,042] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list' [2022-12-18 20:09:47,093] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt [2022-12-18 20:09:55,425] 473 DEBUG MainThread ssh.expect :: Output: ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------ application version manifest name manifest file status progress ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------ cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests applying retrieving docker images ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------ [sysadmin@controller-0 ~(keystone_admin)]$ [2022-12-18 20:09:55,426] 351 DEBUG MainThread ssh.send :: Send 'echo $?' [2022-12-18 20:09:55,478] 473 DEBUG MainThread ssh.expect :: Output: 0 [sysadmin@controller-0 ~(keystone_admin)]$ [2022-12-18 20:10:00,484] 534 DEBUG MainThread ssh.exec_cmd:: Executing command... [2022-12-18 20:10:00,484] 541 DEBUG MainThread ssh.exec_cmd:: Running command: system --os-endpoint-type internalURL --os-region-name RegionOne application-list [2022-12-18 20:10:00,484] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list' [2022-12-18 20:10:00,534] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt [2022-12-18 20:10:09,264] 473 DEBUG MainThread ssh.expect :: Output: ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- application version manifest name manifest file status progress ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests apply-failed Unexpected process termination while application-apply was in progress. The application status has changed from 'applying' to 'apply-failed'. ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- [sysadmin@controller-0 ~(keystone_admin)]$ [2022-12-18 20:10:00,484] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list' [2022-12-18 20:10:00,534] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt [2022-12-18 20:10:09,264] 473 DEBUG MainThread ssh.expect :: Output: ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- application version manifest name manifest file status progress ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests apply-failed Unexpected process termination while application-apply was in progress. The application status has changed from 'applying' to 'apply-failed'. ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- [sysadmin@controller-0 ~(keystone_admin)]$ Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fb6677e3bb5854c537a578d135dfa0627a399bb3d85278065584b8ea677e69ec": plugin type="multus" name="multus-cni-network" failed (add): Multus: [platform-deployment-manager/platform-deployment-manager-699b9bb75b-gj7xp/]: error getting pod: Get "https://[10.96.0.1]:443/api/v1/namespaces/platform-deployment-manager/pods/platform-deployment-manager-699b9bb75b-gj7xp?timeout=1m0s": dial tcp 10.96.0.1:443: connect: no route to host Test Activity ------------- installation Workaround ------------- Run the system application-apply platform-integ-apps command manually and it passes Brief Description ----------------- SX system installation failed by platform-integ-apps apply-failed Severity -------- Minor - Issue stopped the auto-installer from declaring a successful install. But the workaround is to re-apply platform-integ-apps Steps to Reproduce ------------------ Install system Expected Behavior ------------------ DM config platform-integ-apps success Actual Behavior ---------------- DM config platform-integ-apps failed Reproducibility --------------- this is the first time saw this issue System Configuration -------------------- One node system Branch/Pull Time/Commit ----------------------- Timestamp/Logs -------------- [2022-12-18 20:09:47,042] 541 DEBUG MainThread ssh.exec_cmd:: Running command: system --os-endpoint-type internalURL --os-region-name RegionOne application-list [2022-12-18 20:09:47,042] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list' [2022-12-18 20:09:47,093] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt [2022-12-18 20:09:55,425] 473 DEBUG MainThread ssh.expect :: Output: ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------ application version manifest name manifest file status progress ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------ cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests applying retrieving docker images ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}------{}{}------------------------ [sysadmin@controller-0 ~(keystone_admin)]$ [2022-12-18 20:09:55,426] 351 DEBUG MainThread ssh.send :: Send 'echo $?' [2022-12-18 20:09:55,478] 473 DEBUG MainThread ssh.expect :: Output: 0 [sysadmin@controller-0 ~(keystone_admin)]$ [2022-12-18 20:10:00,484] 534 DEBUG MainThread ssh.exec_cmd:: Executing command... [2022-12-18 20:10:00,484] 541 DEBUG MainThread ssh.exec_cmd:: Running command: system --os-endpoint-type internalURL --os-region-name RegionOne application-list [2022-12-18 20:10:00,484] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list' [2022-12-18 20:10:00,534] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt [2022-12-18 20:10:09,264] 473 DEBUG MainThread ssh.expect :: Output: ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- application version manifest name manifest file status progress ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests apply-failed Unexpected process termination while application-apply was in progress. The           application status has changed from 'applying' to 'apply-failed'. ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- [sysadmin@controller-0 ~(keystone_admin)]$ [2022-12-18 20:10:00,484] 351 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne application-list' [2022-12-18 20:10:00,534] 548 DEBUG MainThread ssh.exec_cmd:: Expecting [.@controller-[01] .(keystone_admin)]\$ in prompt [2022-12-18 20:10:09,264] 473 DEBUG MainThread ssh.expect :: Output: ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- application version manifest name manifest file status progress ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- cert-manager 22.12-1 cert-manager-fluxcd-manifests fluxcd-manifests applied completed nginx-ingress-controller 22.12-1 nginx-ingress-controller-fluxcd-manifests fluxcd-manifests applied completed oidc-auth-apps 22.12-1 oidc-auth-apps-fluxcd-manifests fluxcd-manifests uploaded completed platform-integ-apps 22.12-55 platform-integ-apps-fluxcd-manifests fluxcd-manifests apply-failed Unexpected process termination while application-apply was in progress. The           application status has changed from 'applying' to 'apply-failed'. ------------------------{}------{}+{}---------------------------------------{}{}--------------{}{}----------{}{}---------------------------------------------------------------------------- [sysadmin@controller-0 ~(keystone_admin)]$ Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fb6677e3bb5854c537a578d135dfa0627a399bb3d85278065584b8ea677e69ec": plugin type="multus" name="multus-cni-network" failed (add): Multus: [platform-deployment-manager/platform-deployment-manager-699b9bb75b-gj7xp/]: error getting pod: Get "https://[10.96.0.1]:443/api/v1/namespaces/platform-deployment-manager/pods/platform-deployment-manager-699b9bb75b-gj7xp?timeout=1m0s": dial tcp 10.96.0.1:443: connect: no route to host Test Activity ------------- installation Workaround ------------- Run the system application-apply platform-integ-apps command manually and it passes