rpc_workers default value ignores setting of api_workers

Bug #1838689 reported by Adam Spiers
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
neutron
Fix Released
Medium
Adam Spiers

Bug Description

The help for the rpc_workers config option is:

    Number of RPC worker processes for service. If not specified, the
    default is equal to half the number of API workers.

However, this does not accurately describe the current behaviour, which is to default to half the _default_ number of API workers. This can make a big difference; for example on a 256-CPU machine with 256GB of RAM which has api_workers configured to 8 but rpc_workers not configured to anything, this will result in 64 RPC workers, which is 8 for every API worker!

Changed in neutron:
assignee: nobody → Adam Spiers (adam.spiers)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (master)

Fix proposed to branch: master
Review: https://review.opendev.org/674125

Changed in neutron:
status: New → In Progress
Revision history for this message
Adam Spiers (adam.spiers) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/674227

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (master)

Reviewed: https://review.opendev.org/674125
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=61d149c0123997accc5c48994d7a4d1514eb49c9
Submitter: Zuul
Branch: master

commit 61d149c0123997accc5c48994d7a4d1514eb49c9
Author: Adam Spiers <email address hidden>
Date: Thu Aug 1 20:37:09 2019 +0100

    Fix default RPC worker count

    The help for the rpc_workers config option is:

        Number of RPC worker processes for service. If not specified, the
        default is equal to half the number of API workers.

    However, this does not accurately describe the current behaviour,
    which is to default to half the _default_ number of API workers. This
    can make a big difference; for example on a 256-CPU machine with 256GB
    of RAM which has api_workers configured to 8 but rpc_workers not
    configured to anything, this will result in 64 RPC workers, which is 8
    for every API worker!

    Therefore tweak the default to rely on the actual value of
    api_workers, which may be different than the default value.

    Change-Id: I26115932ef4775f157297be1637ee26a4fca4666
    Related-Bug: #1838688
    Closes-Bug: #1838689

Changed in neutron:
status: In Progress → Fix Released
Changed in neutron:
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (stable/stein)

Reviewed: https://review.opendev.org/674227
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=2e7dd4db88a37726ed71e3e9215b7392a1aa9c42
Submitter: Zuul
Branch: stable/stein

commit 2e7dd4db88a37726ed71e3e9215b7392a1aa9c42
Author: Adam Spiers <email address hidden>
Date: Thu Aug 1 20:37:09 2019 +0100

    Fix default RPC worker count

    The help for the rpc_workers config option is:

        Number of RPC worker processes for service. If not specified, the
        default is equal to half the number of API workers.

    However, this does not accurately describe the current behaviour,
    which is to default to half the _default_ number of API workers. This
    can make a big difference; for example on a 256-CPU machine with 256GB
    of RAM which has api_workers configured to 8 but rpc_workers not
    configured to anything, this will result in 64 RPC workers, which is 8
    for every API worker!

    Therefore tweak the default to rely on the actual value of
    api_workers, which may be different than the default value.

    Change-Id: I26115932ef4775f157297be1637ee26a4fca4666
    Related-Bug: #1838688
    Closes-Bug: #1838689
    (cherry picked from commit 61d149c0123997accc5c48994d7a4d1514eb49c9)

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/neutron 15.0.0.0b1

This issue was fixed in the openstack/neutron 15.0.0.0b1 development milestone.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/neutron 14.0.3

This issue was fixed in the openstack/neutron 14.0.3 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.