Improve performance of security groups rpc-related code
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Mirantis OpenStack |
Fix Committed
|
High
|
Alexander Ignatov | ||
6.0.x |
Fix Released
|
High
|
Denis Meltsaykin | ||
6.1.x |
Fix Released
|
High
|
Eugene Nikanorov | ||
7.0.x |
Fix Released
|
High
|
Alexander Ignatov |
Bug Description
In a case when large number of VMs (> 2-3 thousand) reside in one L2 network, security group listing for ports requested from OVS agents consumes significant amount of CPU.
When VM is spawned on such network, every OVS agent requests update sec groups info on each of its devices.
Total time needed to process all such RPC requests that were caused by 1 VM spawn may reach tens of cpu-seconds.
Original neutron bug: https:/
Changed in mos: | |
status: | New → In Progress |
OSCI Robot (oscirobot) wrote : | #1 |
OSCI Robot (oscirobot) wrote : | #2 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2.2, package release == fuel6.1~
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
python-
...
OSCI Robot (oscirobot) wrote : | #3 |
package neutron has been built for project openstack/neutron
Package version == 2014.2.2, package release == fuel6.1~
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
NOTE: Changeset is not merged, created temporary package repository.
repository URL: /ubuntu-
tags: | added: scale |
OSCI Robot (oscirobot) wrote : | #5 |
package neutron has been built for project openstack/neutron
Package version == 2014.2.2, package release == fuel6.1~
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
NOTE: Changeset is not merged, created temporary package repository.
repository URL: /trusty-
Eugene Nikanorov (enikanorov) wrote : | #6 |
patch to 6.0.1:
https:/
OSCI Robot (oscirobot) wrote : | #7 |
RPM package neutron has been built for project openstack/neutron
Package version == 2014.2.2, package release == fuel6.0.
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
python-
NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://
OSCI Robot (oscirobot) wrote : | #8 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2.2, package release == fuel6.0.
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
OSCI Robot (oscirobot) wrote : | #9 |
RPM package neutron has been built for project openstack/neutron
Package version == 2014.2.2, package release == fuel6.0.1.mira5
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: change-merged
Files placed on repository:
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
python-
Changeset merged. Package placed on primary repository
RPM repository URL: http://
OSCI Robot (oscirobot) wrote : | #10 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2.2, package release == fuel6.0.1~mira5
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: change-merged
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
python-
Changeset merged. Package placed on primary repository
DEB repository URL: http://
OSCI Robot (oscirobot) wrote : | #11 |
RPM package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0.
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
python-
NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://
OSCI Robot (oscirobot) wrote : | #12 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0~
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
python-
NOTE: Changeset is not merged...
OSCI Robot (oscirobot) wrote : | #13 |
RPM package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0.mira20
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Add the rebinding chance in _bind_port_
status: change-merged
Files placed on repository:
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
python-
Changeset merged. Package placed on primary repository
RPM repository URL: http://
OSCI Robot (oscirobot) wrote : | #14 |
RPM package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0.mira20
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Alex Ermolov
committer: Alex Ermolov
subject: Fix incorrect exception reference
status: change-merged
Files placed on repository:
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
python-
Changeset merged. Package placed on primary repository
RPM repository URL: http://
OSCI Robot (oscirobot) wrote : | #15 |
RPM package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0.mira20
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Make listing security groups faster
status: change-merged
Files placed on repository:
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
python-
Changeset merged. Package placed on primary repository
RPM repository URL: http://
OSCI Robot (oscirobot) wrote : | #16 |
RPM package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0.mira21
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: radvd: pass -m syslog to avoid thread lock for radvd 2.0+
status: change-merged
Files placed on repository:
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
openstack-
python-
Changeset merged. Package placed on primary repository
RPM repository URL: http://
OSCI Robot (oscirobot) wrote : | #17 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0~mira19
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Add the rebinding chance in _bind_port_
status: change-merged
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
python-
Changeset merged. Package placed on primary repository
DEB repository URL: http://
OSCI Robot (oscirobot) wrote : | #18 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0~mira19
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Alexandr Nevenchannyy
committer: Alexandr Nevenchannyy
subject: Make listing security groups faster
status: change-merged
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
python-
Changeset merged. Package placed on primary repository
DEB repository URL: http://
OSCI Robot (oscirobot) wrote : | #19 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0~mira19
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Alex Ermolov
committer: Alex Ermolov
subject: Fix incorrect exception reference
status: change-merged
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
python-
Changeset merged. Package placed on primary repository
DEB repository URL: http://
OSCI Robot (oscirobot) wrote : | #20 |
DEB package neutron has been built for project openstack/neutron
Package version == 2014.2, package release == fuel6.0~mira19
Changeset: https:/
project: openstack/neutron
branch: openstack-
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: radvd: pass -m syslog to avoid thread lock for radvd 2.0+
status: change-merged
Files placed on repository:
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
neutron-
python-
Changeset merged. Package placed on primary repository
DEB repository URL: http://
Leontii Istomin (listomin) wrote : | #21 |
Will try to spawn 3000 VMs on scale lab. Which information should I collect?
Leontii Istomin (listomin) wrote : | #22 |
- rally.tar.gz Edit (3.0 MiB, application/x-tar)
Used 6.1-425 build
I've tried to run 3000 instances with concurrency=5. Actually only 834 VMs are in ACTIVE state. Also 166 VMs aren't in ACTIVE state. all instances was in one neutron subnetwork, in one tenant.
Time of booting an instance doesn't depend on number of instances in the same subnet. It was around 20sec during the test.
rally logs and results are attached.
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/neutron (openstack-ci/fuel-7.0/2015.1.0) | #23 |
Reviewed: https:/
Submitter: mos-infra-ci <>
Branch: openstack-
Commit: b31ba09215e4335
Author: Alexander Ignatov <email address hidden>
Date: Tue Jul 14 10:49:09 2015
Merge the latest state of stable/kilo
Closes-Bug: #1450142
Closes-Bug: #1457123
Closes-Bug: #1430171
Closes-Bug: #1460655
Closes-Bug: #1454421
Closes-Bug: #1442334
Closes-Bug: #1466490
Change-Id: Ie44d227cb6be93
Sergey Shevorakov (sshevorakov) wrote : | #24 |
Added to 7.0 MU1, since it needs QA verification.
tags: | added: 70mu1-confirmed |
tags: | removed: 70mu1-confirmed |
Mikhail Chernik (mchernik) wrote : | #25 |
Reporduced in MOS 7.0 GA, build 301.
HA, 3 controllers, 200 computes, VxLAN+DVR
Vitaly Sedelnik (vsedelnik) wrote : | #26 |
This issues was fixed in 7.0-mu-1. It is expected to fail on 7.0 GA. Setting back to Fix Released.
package neutron has been built for project openstack/neutron mira11. git.397128c. 8256a3e
Package version == 2014.2.2, package release == fuel6.1.
Changeset: https:/ /review. fuel-infra. org/4446 ci/fuel- 6.1/2014. 2 group_member_ ips
project: openstack/neutron
branch: openstack-
author: Eugene Nikanorov
committer: Eugene Nikanorov
subject: Improve performance of _get_security_
status: patchset-created
Files placed on repository:
NOTE: Changeset is not merged, created temporary package repository. fuel-6. 1-stable- 4446/
repository URL: /centos-