Add rpc tunables to nova.conf

Bug #1471926 reported by Bjoern
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
Wishlist
Matthew Thode
Juno
Fix Released
Wishlist
Matthew Thode
Kilo
Fix Released
Wishlist
Matthew Thode
Trunk
Fix Released
Wishlist
Matthew Thode

Bug Description

Please add the following rpc settings for oslo.messaging when running nova service via the nova.conf :

[DEFAULT]
rpc_thread_pool_size = 180
rpc_conn_pool_size = 180
rpc_response_timeout = 180

I would propose 180 as default settings, the original default values are way too low in case you spin up more than 80 instances at once , causing RPC timeouts/waiting for message errors.

Revision history for this message
Bjoern (bjoern-t) wrote :

This needs to be back ported to Juno

Revision history for this message
Christopher H. Laco (claco) wrote :

This is likely a duplicate of https://github.com/rcbops/rpc-openstack/issues/220, which is seen as more of a deployer specific set of tweaks given a known hardware configuration.

Revision history for this message
Nolan Brubaker (nolan-brubaker) wrote :

Not sure it's a duplicate; if the variables don't exist in OSAD, they'd need to be added for a deployer to take advantage of them.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (master)

Fix proposed to branch: master
Review: https://review.openstack.org/205204

Changed in openstack-ansible:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (kilo)

Fix proposed to branch: kilo
Review: https://review.openstack.org/205205

Revision history for this message
Matthew Thode (prometheanfire) wrote :

It doesn't look like this is backportable to juno, no rpc config options that I could find in http://docs.openstack.org/juno/config-reference/content/list-of-compute-config-options.html

I'm gonna be checking a generated config via tox -egenconfig to be sure though

Revision history for this message
Bjoern (bjoern-t) wrote :

Yes, it's not in the docs. I found that parameter in the code or at oslo.messaging docs

Revision history for this message
Matthew Thode (prometheanfire) wrote :

ya, just generated an example config and it's there, will be adding it shortly

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (juno)

Fix proposed to branch: juno
Review: https://review.openstack.org/205256

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on os-ansible-deployment (kilo)

Change abandoned by Matthew Thode (<email address hidden>) on branch: kilo
Review: https://review.openstack.org/205205
Reason: abandoning as a bad cherrypick (bad change-id, same as master)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (kilo)

Fix proposed to branch: kilo
Review: https://review.openstack.org/205270

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (master)

Reviewed: https://review.openstack.org/205204
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=e09823570fa5ee4043b4990cea301504a256aae5
Submitter: Jenkins
Branch: master

commit e09823570fa5ee4043b4990cea301504a256aae5
Author: Matthew Thode <email address hidden>
Date: Thu Jul 23 12:58:37 2015 -0500

    Add remote procedure call tunables to nova and neutron

    This allows us to override the default settings, which is useful for
    large deployments or deploying a large number of instances. It also
    uses an unused variable in neutron for setting the rpc_backend.

    Change-Id: I83d11eb79b30dda51c6f738433ca960a0f63246e
    Closes-bug: 1471926

Changed in openstack-ansible:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (kilo)

Reviewed: https://review.openstack.org/205270
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=cc3a2898749236371fec52a5deb37d6a9051a3a0
Submitter: Jenkins
Branch: kilo

commit cc3a2898749236371fec52a5deb37d6a9051a3a0
Author: Matthew Thode <email address hidden>
Date: Thu Jul 23 12:58:37 2015 -0500

    Add remote procedure call tunables to nova and neutron

    This allows us to override the default settings, which is useful for
    large deployments or deploying a large number of instances. It also
    uses an unused variable in neutron for setting the rpc_backend.

    Change-Id: I25634233efbb3e47ac9a4e199d5caf072b13fd92
    Closes-bug: 1471926
    (cherry-picked from commit I83d11eb79b30dda51c6f738433ca960a0f63246e)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (juno)

Reviewed: https://review.openstack.org/205256
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=d715e1c81860a04467df35167f4b8ff8638f8e49
Submitter: Jenkins
Branch: juno

commit d715e1c81860a04467df35167f4b8ff8638f8e49
Author: Matthew Thode <email address hidden>
Date: Thu Jul 23 14:36:16 2015 -0500

    Add remote procedure call tunables to nova and neutron

    This allows us to override the default settings, which is useful for
    large deployments or deploying a large number of instances.

    Change-Id: I226be0147b8b5a0b71cdda1bfb25d06b57815f2a
    Closes-bug: 1471926
    (cherry picked from commit I83d11eb79b30dda51c6f738433ca960a0f63246e)

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote : Fix included in openstack/openstack-ansible 11.2.14

This issue was fixed in the openstack/openstack-ansible 11.2.14 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.