neutron-ns-meta invokes oom-killer during gate runs
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
neutron |
Invalid
|
High
|
Salvatore Orlando |
Bug Description
Occasionally a neutron gate job fails because the node runs out of memory. oom-killer is invoked and it starts killing processes to save the node. (which just causes cascading issues) The kernel logs show that oom-killer is being invoked by neutron-ns-meta.
An example of one such failure is:
http://
With the kernel log:
Using logstash this failure can be isolated to only neutron gate jobs. So there is probably something triggering neutron to occasionally make the job consume in excess of 8GB of ram.
I also noted in the neutron svc log that first out of memory error came from using keystone-
but that may just be a red herring.
tags: | added: gate-failure |
summary: |
- neutron-ns-meta invokes oom-killer during gate runs + gneutron-ns-meta invokes oom-killer during gate runs |
summary: |
- gneutron-ns-meta invokes oom-killer during gate runs + neutron-ns-meta invokes oom-killer during gate runs |
Changed in neutron: | |
assignee: | nobody → Salvatore Orlando (salvatore-orlando) |
milestone: | none → juno-3 |
Changed in neutron: | |
milestone: | juno-3 → juno-rc1 |
Changed in neutron: | |
milestone: | juno-rc1 → kilo-1 |
Changed in neutron: | |
milestone: | kilo-1 → none |
Tracking in logstash with:
http:// logstash. openstack. org/#eyJzZWFyY2 giOiJ0YWdzOnN5c 2xvZyBBTkQgbWVz c2FnZTpcIm9vbS1 raWxsZXJcIiIsIm ZpZWxkcyI6W10sI m9mZnNldCI6MCwi dGltZWZyYW1lIjo iNjA0ODAwIiwiZ3 JhcGhtb2RlIjoiY 291bnQiLCJ0aW1l Ijp7InVzZXJfaW5 0ZXJ2YWwiOjB9LC JzdGFtcCI6MTQwO TE2NDcwNzcxM30=