RPC Timeout on Backup Operation
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Fix Released
|
Low
|
Iago Regiani |
Bug Description
Brief Description
-----------------
The backup playbook notifies all applications via an RPC call, triggering lifecycle hooks, and nginx-ingress-
Severity
--------
Minor
Steps to Reproduce
------------------
Perform an upgrade from r/stx4.0 to r/stx5.0, then run the Ansible backup
Expected Behavior
------------------
Backup playbook should complete successfully
Actual Behavior
----------------
backup playbook fails at the task "Fail if there is some other/internal error when sending lifecycle hook"
Reproducibility
---------------
Reproducible
System Configuration
-------
SX
Branch/Pull Time/Commit
-------
NA
Last Pass
---------
NA
Timestamp/Logs
--------------
sysinv 2021-10-14 20:56:44.595 398375 CRITICAL sysinv [-] Unhandled error: Timeout: Timeout while waiting on RPC response - topic: "sysinv.
2021-10-14 20:56:44.595 398375 ERROR sysinv Traceback (most recent call last):
2021-10-14 20:56:44.595 398375 ERROR sysinv File "/usr/bin/
2021-10-14 20:56:44.595 398375 ERROR sysinv sys.exit(main())
2021-10-14 20:56:44.595 398375 ERROR sysinv File "/usr/lib64/
2021-10-14 20:56:44.595 398375 ERROR sysinv CONF.action.
2021-10-14 20:56:44.595 398375 ERROR sysinv File "/usr/lib64/
2021-10-14 20:56:44.595 398375 ERROR sysinv ok, app = rpcapi.
2021-10-14 20:56:44.595 398375 ERROR sysinv File "/usr/lib64/
2021-10-14 20:56:44.595 398375 ERROR sysinv timeout=120,
2021-10-14 20:56:44.595 398375 ERROR sysinv File "/usr/lib64/
2021-10-14 20:56:44.595 398375 ERROR sysinv exc.info, real_topic, msg.get('method'))
2021-10-14 20:56:44.595 398375 ERROR sysinv Timeout: Timeout while waiting on RPC response - topic: "sysinv.
Test Activity
-------------
Feature Testing
Workaround
----------
Run ansible backup playbook again
Changed in starlingx: | |
status: | New → In Progress |
screening: low / not gating - issue w/ specific B&R test; workaround exists