Load-import hangs indefinitely in importing state
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Fix Released
|
Medium
|
Virginia Martins Perozim |
Bug Description
Brief Description
-----------------
Shortly after receiving a load-import request, sysinv conductor restarted the load import hangs indefinitely.
Severity
--------
Major: upgrade fails
Steps to Reproduce
------------------
Update dcmanager orchestration code to induce importing the entire bootimage.iso to the simplex subclouds in DC-2. Note: code change is required for this test due to lack of DC labs with 50 AIO-DX subclouds.
Perform 50 concurrent load imports via upgrade orchestration
Expected Behavior
------------------
Load import is successful
Actual Behavior
----------------
In the middle of load import, sysinv conductor restarted. After 30 minute wait, the upgrade thread on the system controller exited with an error. The load import state remains as importing indefinitely.
Reproducibility
---------------
Intermittently
System Configuration
-------
IPv6
Branch/Pull Time/Commit
-------
master
Last Pass
---------
Below the notes from last test:
except for https:/
The updates for load-import were verified with 50 subclouds: https:/
Timestamp/Logs
--------------
sysinv 2021-12-01 17:13:59.211 99321 INFO sysinv.
sysinv 2021-12-01 17:15:45.560 99016 INFO oslo_service.
sysinv 2021-12-01 17:15:45.566 99016 INFO oslo.service.wsgi [-] Stopping WSGI server.
sysinv 2021-12-01 17:15:45.566 99016 INFO oslo_service.
sysinv 2021-12-01 17:15:45.567 99321 INFO oslo.service.wsgi [-] Stopping WSGI server.
sysinv 2021-12-01 17:16:02.057 99322 INFO oslo_service.
sysinv 2021-12-01 17:16:02.059 99322 INFO oslo.service.wsgi [-] Stopping WSGI server.
sysinv 2021-12-01 17:16:02.059 99322 INFO oslo.service.wsgi [-] Stopping WSGI server.
sysinv 2021-12-01 17:16:02.066 99321 INFO oslo_service.
sysinv 2021-12-01 17:16:02.067 99321 INFO oslo.service.wsgi [-] Stopping WSGI server.
Test Activity
-------------
Developer Test
Workaround
----------
N/A
Changed in starlingx: | |
assignee: | nobody → Virginia Martins Perozim (vmperozim) |
status: | New → In Progress |
tags: | added: stx.config stx.distcloud |
tags: | removed: stx.config |
Changed in starlingx: | |
importance: | Undecided → Medium |
tags: | added: stx.8.0 |
Fix proposed to branch: master /review. opendev. org/c/starlingx /config/ +/832789
Review: https:/