Set max_overflow and max_pool_size parameters in depend on hardware

Bug #1653077 reported by Leontii Istomin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
fuel-ccp
Fix Released
Undecided
Peter Razumovsky

Bug Description

We have faced with the following error from neutron-server logs during spawning 48 instances using heat: http://paste.openstack.org/show/593483/

We need to increase max_overflow and max_pool_size parameters. I suggest to use Fuel experience and set those parameters in depend on available hardware resources on a node. Implementation in Fuel: https://github.com/openstack/fuel-library/blob/stable/mitaka/deployment/puppet/osnailyfacter/manifests/globals/globals.pp#L332-L333

environment description:
200 hardware nodes, calico network. ccp configs are attached

Tags: scale
Revision history for this message
Leontii Istomin (listomin) wrote :
Changed in fuel-ccp:
assignee: nobody → Peter Razumovsky (prazumovsky)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-ccp (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/424095

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Related fix proposed to branch: master
Review: https://review.openstack.org/424096

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-ccp-entrypoint (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/424097

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-ccp-neutron (master)

Fix proposed to branch: master
Review: https://review.openstack.org/424526

Changed in fuel-ccp:
status: New → In Progress
Revision history for this message
Peter Razumovsky (prazumovsky) wrote :

There was the decision to let MK or manually calculate necessary values of max_overflow and max_pool_size, so adding these config options (and ability to configure specific node) is enough from CCP side.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-ccp-neutron (master)

Reviewed: https://review.openstack.org/424526
Committed: https://git.openstack.org/cgit/openstack/fuel-ccp-neutron/commit/?id=3f0d6ecede79cfdca7ef4bec340611ff4a4a8b44
Submitter: Jenkins
Branch: master

commit 3f0d6ecede79cfdca7ef4bec340611ff4a4a8b44
Author: Peter Razumovsky <email address hidden>
Date: Tue Jan 24 13:13:02 2017 +0400

    Add config options for database section

    Add max_pool_size and max_overflow for database section
    of config file. This helps to customize database limits for
    ccp and further for each node.

    Change-Id: Ibfe7ac44e73b8540d7cfe73eaae041c70bbc9a73
    Closes-bug: #1653077

Changed in fuel-ccp:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-ccp (master)

Reviewed: https://review.openstack.org/424095
Committed: https://git.openstack.org/cgit/openstack/fuel-ccp/commit/?id=341d3582e0a99baf3733612417b693752eaf89e3
Submitter: Jenkins
Branch: master

commit 341d3582e0a99baf3733612417b693752eaf89e3
Author: Peter Razumovsky <email address hidden>
Date: Mon Jan 23 15:09:10 2017 +0400

    Add configs map for nodes

    Now node definition can contain configs map,
    which will add new configs especially for this node
    or override current globals for the node.

    Change-Id: I4de6a0fad94d5f83ca486c952d80d1c87c880c0e
    Related-bug: #1653077

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-ccp-entrypoint (master)

Reviewed: https://review.openstack.org/424097
Committed: https://git.openstack.org/cgit/openstack/fuel-ccp-entrypoint/commit/?id=0feaf3e1c26ad9eb3223cd468bbbb07077c31872
Submitter: Jenkins
Branch: master

commit 0feaf3e1c26ad9eb3223cd468bbbb07077c31872
Author: Peter Razumovsky <email address hidden>
Date: Mon Jan 23 15:52:27 2017 +0400

    Handle nodes configs and merge them with globals

    Get nodes configs map, check for existing configs for
    current node, and if it is, merge it with globals config - variables
    for further using in jinja and so on.

    Change-Id: I379f4840e6093b7910b5d7dd612de62b1fe0ac2e
    Depends-on: I4de6a0fad94d5f83ca486c952d80d1c87c880c0e
    Related-bug: #1653077

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-ccp (master)

Reviewed: https://review.openstack.org/424096
Committed: https://git.openstack.org/cgit/openstack/fuel-ccp/commit/?id=df907ee69860d758ea81ad005bf6dac7dbc0a8e8
Submitter: Jenkins
Branch: master

commit df907ee69860d758ea81ad005bf6dac7dbc0a8e8
Author: Peter Razumovsky <email address hidden>
Date: Mon Jan 23 16:52:18 2017 +0400

    Add documentation for nodes configs

    Added new sub-key definition to documentation. Refactor nodes
    and roles key types description in docs.

    Change-Id: Ie8f15044e05c67e1ed1a8919e07ded3518e6b24c
    Depends-on: I379f4840e6093b7910b5d7dd612de62b1fe0ac2e
    Related-bug: #1653077

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.