[Errno 24] Too many open files error on simple deployment with neutron
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Invalid
|
Medium
|
Tatyanka |
Bug Description
Steps to reproduce:
235 iso:
Ubuntu simple with murano:
network: neutron untagged vlan
1 controller + 4 compute
1. Set each network on separate interface
2. Untagg networks
3. Run network verification
4. Run deployment
5. When deployment finish with succes - run all ostf tests
Expected result:
tests are passed
Actual result:
Some instance failed to get ACTIVE state, stack in build status. Also I can no delete them. All qemu processes are run.
As soon as test are fail on step wait until instance become Active - next trace appear in nova-api
http://
on controller we can see that nova -api has more than 1024 opened fd (1024 set by default value for open files ulimit -n show 1024)
root@node-14:~# lsof -p 16906 | wc -l
2150
If we set for this limit value 65534 (in /etc/init/
root@node-14:~# cat /etc/init/
http://
restart nova services and run ostf omne more time - mysql go away
2014-03-
2014-03-
2014-03-
2014-03-
2014-03-
also in we run netstat - there is a lot of next rows:
tcp 0 0 10.108.1.2:8774 10.108.1.2:54348 ESTABLISHED 16906/python
Reproduced 2 times from 2 attempts
in logs controller nodes are 14 for second deployment and 11 for first attemp
Changed in fuel: | |
milestone: | none → 4.1.1 |
importance: | Undecided → Medium |
Changed in fuel: | |
milestone: | 4.1.1 → 5.0 |
tags: | added: backports-4.1.1 |
Changed in fuel: | |
status: | Incomplete → Opinion |
status: | Opinion → Confirmed |
Changed in fuel: | |
status: | Confirmed → Incomplete |
Changed in fuel: | |
assignee: | Fuel Library Team (fuel-library) → Tatyana (tatyana-leontovich) |
also qemu processes are not killed and after several retries create instance and then delete it - we have race condition and qemu processes eat all resources