Neutron error during the termination of large group of VMs

Bug #1321647 reported by Timur Nurlygayanov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Committed
High
MOS Neutron
4.1.x
Won't Fix
High
MOS Neutron

Bug Description

Looks like this issue is already fixed in Icehouse: https://review.openstack.org/#/c/58017/

Environment:
MOS 4.1a, OpenStack Havanna, CentOS 6.4, Neutron with GRE, 1 controller node and 4 compute nodes.

Steps To Reproduce:
1. Create 200 VMs with Cirros Image.
2. Delete 100+ VMs with one request (in Horizon dashboard)

Observed Result:
Part of VMs will be successfully removed, but when we select the large group of servers, we can see the error message in Horizon and the traceback in nova.log and neutron.log

The root of this problem in the limit on requests/seconds for Neutron API and we can fix this problem - we should just increase the number of Neutron workers: need to set 'api_workers = 10' in /etc/neutron/neutron.conf.

Please, see for more detailed information:
https://bugs.launchpad.net/neutron/+bug/1321626

Note:
This issue is important for enterprise-deployment, where users can create more that 202 VMs simultaneously.
Of course, we can not predict the correct number of workers for any deployments, but we can set the basic configuration with 10 or 20 workers to cover many typical installations. Also, we can add a few words in the documentation about this problem.

tags: added: neutron
description: updated
Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

It is fixed in Icehouse release, need to fix in 4.1.1
https://review.openstack.org/#/c/58017/

Changed in fuel:
milestone: 5.1 → 4.1.1
Changed in fuel:
assignee: nobody → Fuel OSCI Team (fuel-osci)
Roman Vyalov (r0mikiam)
Changed in fuel:
assignee: Fuel OSCI Team (fuel-osci) → Fuel Hardening Team (fuel-hardening)
Changed in fuel:
milestone: 4.1.1 → 4.1.2
Changed in fuel:
importance: Medium → High
tags: added: release-notes
Ilya Shakhat (shakhat)
Changed in fuel:
assignee: Fuel Hardening Team (fuel-hardening) → MOS Neutron (mos-neutron)
Ilya Shakhat (shakhat)
Changed in mos:
assignee: nobody → MOS Neutron (mos-neutron)
Changed in mos:
importance: Undecided → High
milestone: none → 5.1
Revision history for this message
Andrey Epifanov (aepifanov) wrote :
Changed in mos:
status: New → Fix Committed
Changed in fuel:
status: Confirmed → Won't Fix
Revision history for this message
Dmitry Mescheryakov (dmitrymex) wrote :

The bug is in OpenStack and is not related to deployment. Hence moved 4.1 series from Fuel to MOS

no longer affects: fuel
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.