Fullstack linux bridge agent sometimes refuses to die during test clean up, failing the test
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
neutron |
Fix Released
|
High
|
Assaf Muller |
Bug Description
Paste of failure:
http://
When looking at the LB agent logs, you start seeing RPC errors as neutron-server is unable to access the DB. What's happening is that fullstack times out trying to kill the LB agent and moves on to other clean ups. It deletes the DB for the test, but the agents and neutron-server live on, resulting in errors trying to access the DB. The DB errors are essentially unrelated - The root cause is that the agent refuses to die for an unknown reason.
The code that tries to stop the agent is AsyncProcess.
Another detail that might be relevant is that the agent lives in a namespace.
To reproduce locally, go to the VM running the fullstack tests and load all CPUs to 100%, then run:
tox -e dsvm-fullstack TestLinuxBridge
tags: | added: linuxbridge |
Changed in neutron: | |
milestone: | none → newton-1 |
description: | updated |
Changed in neutron: | |
assignee: | nobody → Slawek Kaplonski (slaweq) |
Changed in neutron: | |
assignee: | Assaf Muller (amuller) → Jakub Libosvar (libosvar) |
Changed in neutron: | |
assignee: | Jakub Libosvar (libosvar) → Assaf Muller (amuller) |
Changed in neutron: | |
assignee: | Assaf Muller (amuller) → Jakub Libosvar (libosvar) |
Changed in neutron: | |
assignee: | Jakub Libosvar (libosvar) → Assaf Muller (amuller) |
Changed in neutron: | |
assignee: | Assaf Muller (amuller) → Jakub Libosvar (libosvar) |
Changed in neutron: | |
assignee: | Jakub Libosvar (libosvar) → Assaf Muller (amuller) |
We had the same symptom with the OVS agent, that was fixed via https:/ /review. openstack. org/#/c/ 234770/. I have absolutely no idea if it's related at this point.