AIO-DX upgrade: Activation fails with error failed to find plugin "multus"
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Fix Released
|
Medium
|
Lucas |
Bug Description
Brief Description
------------------
Upgrade from 21.12 Centos to 22.06 Centos fails at activation.
Severity
------------------
Critical
Steps to Reproduce
------------------
Issue was detected using an automated vbox upgrade
Expected Behavior
------------------
Activation process finish successfully.
Actual Behavior
------------------
Activation process fails.
Reproducibility
------------------
Intermittent
Using automation seen most of the time, very high chance of reproduction.
System Configuration
------------------
Last Pass
------------------
Same loads passed other times.
Timestamp/Logs
------------------
/var/log/
```
TASK [common/
Saturday 30 July 2022 03:55:38 +0000 (0:03:59.810) 0:04:18.696 *********
failed: [localhost] (item={
{u'namespace': u'flux-helm', u'deployment': u'helm-controller'}
, u'ansible_job_id': u'443083077343.
{u'namespace': u'flux-helm', u'deployment': u'helm-controller'}
, u'started': 1, 'changed': True, 'failed': False, u'finished': 0, u'results_file': u'/root/
{u'namespace': u'flux-helm', u'deployment': u'helm-controller'}
, u'started': 1, 'changed': True, 'failed': False, u'finished': 0, u'results_file': u'/root/
item:
ansible_job_id: '443083077343.
attempts: 39
changed: true
cmd:
kubectl
--kubeconfig=
wait
--namespace=
--for=condition
deployment
helm-controller
--timeout=240s
delta: '0:04:01.541827'
end: '2022-07-30 03:55:37.644366'
failed: false
failed_when_result: false
finished: 1
invocation:
module_args:
_raw_params: kubectl --kubeconfig=
_uses_shell: false
argv: null
chdir: null
creates: null
executable: null
removes: null
stdin: null
warn: true
item:
ansible_job_id: '443083077343.
changed: true
failed: false
finished: 0
item:
deployment: helm-controller
namespace: flux-helm
results_file: /root/.
started: 1
msg: non-zero return code
rc: 1
start: '2022-07-30 03:51:36.102539'
stderr: 'error: timed out waiting for the condition on deployments/
stderr_lines:
'error: timed out waiting for the condition on deployments/
stdout: ''
stdout_lines: []
msg: 'Pod {u''namespace'': u''flux-helm'', u''deployment'': u''helm-
is still not ready.'
failed: [localhost] (item={
Unknown macro: {'_ansible_parsed'}
, u'start': u'2022-07-30 03:51:37.460869', u'cmd': [u'kubectl', u'--kubeconfig=
{u'namespace': u'flux-helm', u'deployment': u'source-
, u'started': 1, 'changed': True, 'failed': False, u'finished': 0, u'results_file': u'/root/
item:
ansible_job_id: '471441098672.
attempts: 1
changed: true
cmd:
kubectl
--kubeconfig=
wait
--namespace=
--for=condition
deployment
source-controller
--timeout=240s
delta: '0:04:00.555638'
end: '2022-07-30 03:55:38.016507'
failed: false
failed_when_result: false
finished: 1
invocation:
module_args:
_raw_params: kubectl --kubeconfig=
_uses_shell: false
argv: null
chdir: null
creates: null
executable: null
removes: null
stdin: null
warn: true
item:
ansible_job_id: '471441098672.
changed: true
failed: false
finished: 0
item:
deployment: source-controller
namespace: flux-helm
results_file: /root/.
started: 1
msg: non-zero return code
rc: 1
start: '2022-07-30 03:51:37.460869'
stderr: 'error: timed out waiting for the condition on deployments/
stderr_lines:
'error: timed out waiting for the condition on deployments/
stdout: ''
stdout_lines: []
msg: 'Pod {u''namespace'': u''flux-helm'', u''deployment'': u''source-
is still not ready.'
```
Alarms
------------------
Test Activity
------------------
Workaround
------------------
Changed in starlingx: | |
assignee: | nobody → Lucas (lcavalca) |
Changed in starlingx: | |
status: | New → In Progress |
tags: | added: stx.update |
tags: | added: stx.8.0 |
Changed in starlingx: | |
importance: | Undecided → Medium |
Reviewed: https:/ /review. opendev. org/c/starlingx /ansible- playbooks/ +/855364 /opendev. org/starlingx/ ansible- playbooks/ commit/ 7e5861e42210948 580b3c0556007d5 bb769c58a3
Committed: https:/
Submitter: "Zuul (22348)"
Branch: master
commit 7e5861e42210948 580b3c0556007d5 bb769c58a3
Author: Lucas Cavalcante <email address hidden>
Date: Wed Aug 31 09:39:27 2022 -0300
Fix upgrade fails with k8s-networking error
AIO-DX upgrade: Activation fails with error failed to find plugin "multus"
Upgrade from 21.12 Centos to 22.06 Centos fails at activation.
TEST PLAN:
PASS: Vbox automated upgrade works
Closes-bug: 1988305 d368cb0bc47608f 47853d5a2de
Signed-off-by: Lucas Cavalcante <email address hidden>
Change-Id: I9c5c0995cb34fe