Use batching in Heat scheduler

[Sergey Kraynev]

During processing stacks Heat may DDoS other services (on create, delete, etc.) It happens, because all requests will be sent in the same moment of time.

To avoid this situation we need add hook in scheduler, which allows to process all requests using batches.

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Sergey Kraynev <email address hidden>
Review: https://review.fuel-infra.org/7414

[Sergey Kraynev (skraynev)]

This bug was re-assigned on Peter , because he currently works on solution for it.

Also Importance was raised, because it's necessary for scaling Heat by Sahara.

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Sergey Kraynev <email address hidden> on branch: openstack-ci/fuel-7.0/2015.1.0
Review: https://review.fuel-infra.org/7414
Reason: Abandon in favor of

https://review.fuel-infra.org/#/c/9310/

https://review.fuel-infra.org/#/c/9593/

[Sergey Kraynev (skraynev)]

Follow patches were uploaded on review:

https://review.fuel-infra.org/#/c/9310/
https://review.fuel-infra.org/#/c/9593/

They were tested locally.

[Sergey Kraynev (skraynev)]

Wait answer from Scale team (need deployment for testing these patches on Scale).

[Sergey Kraynev (skraynev)]

It can not be ported to 6.1, also Sahara (author of this use case) does not use Heat engine in MOS 6.1

[Dina Belova (dbelova)]

Adding Murano tag as this issue will also affect Murano huge deployments.

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/9593
Submitter: mos-infra-ci <>
Branch: openstack-ci/fuel-7.0/2015.1.0

Commit: 8dcd7fa1c2edc5ca11c8327798f6a9e3f30fb771
Author: Peter Razumovsky <email address hidden>
Date: Wed Aug 19 15:00:57 2015

Batching for tasks in scheduler

Add batch_size config for tasks in scheduler - now
only limited count of tasks can run in one time.

Change-Id: Ie24f16ca9a5b16cb85e976d8a710b0d10d6375c9
Closes-bug: #1439675

[Sergey Kraynev (skraynev)]

https://review.fuel-infra.org/#/c/9593/ was merged, so move this bug to Fix Committed

[Evgeny Sikachev (esikachev)]

Not need verification. In MOS 8.0 used direct engine instead Heat engine

[Evgeny Sikachev (esikachev)]

oops, typo, MOS 7.0 ^^^^^

[Sergey Kraynev (skraynev)]

We need to make sure, that same patch (like for MOS 7.0) will be applied for MOS 8.0 too.

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: openstack-ci/fuel-8.0/liberty
Change author: Peter Razumovsky <email address hidden>
Review: https://review.fuel-infra.org/13387

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: openstack-ci/fuel-8.0/liberty
Change author: Peter Razumovsky <email address hidden>
Review: https://review.fuel-infra.org/13507

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Sergey Kraynev <email address hidden> on branch: openstack-ci/fuel-8.0/liberty
Review: https://review.fuel-infra.org/13387
Reason: Abandon in favor of https://review.fuel-infra.org/#/c/13507/

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/13507
Submitter: Pkgs Jenkins <email address hidden>
Branch: openstack-ci/fuel-8.0/liberty

Commit: 47b8933ceacca4fabb8f1f3fa667cb86e6899a73
Author: Peter Razumovsky <email address hidden>
Date: Wed Dec 2 11:01:34 2015

Batching for tasks in scheduler

Add batch_size config for tasks in scheduler - now
only limited count of tasks can run in one time.

Change-Id: Ic1534038e4c067e5f72023e0b079f100320a93b2
Closes-bug: #1439675

[Sergey Kraynev (skraynev)]

The related patch was merged in the 8.0 branch. so we mark it as Fix commited

[Evgeny Sikachev (esikachev)]

verified on 482iso. 200 nodes scale

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: 9.0/mitaka
Change author: Peter Razumovsky <email address hidden>
Review: https://review.fuel-infra.org/18544

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/18544
Submitter: Pkgs Jenkins <email address hidden>
Branch: 9.0/mitaka

Commit: 920089340f2c05f0b02f8ecdd035bf3b7f971131
Author: Peter Razumovsky <email address hidden>
Date: Mon Mar 28 11:04:05 2016

Batching for tasks in scheduler

Add batch_size config for tasks in scheduler - now
only limited count of tasks can run in one time.

Change-Id: Ic1534038e4c067e5f72023e0b079f100320a93b2
Closes-bug: #1439675

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: 11.0/ocata
Change author: Peter Razumovsky <email address hidden>
Review: https://review.fuel-infra.org/34466

[Fuel Devops McRobotson (fuel-devops-robot)]

Fix proposed to branch: mcp/ocata
Change author: Peter Razumovsky <email address hidden>
Review: https://review.fuel-infra.org/34818

[Fuel Devops McRobotson (fuel-devops-robot)]

Change abandoned by Pavlo Shchelokovskyy <email address hidden> on branch: 11.0/ocata
Review: https://review.fuel-infra.org/34466
Reason: 11.0/ocata branch is deprecated in favor of mcp/ocata

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/34818
Submitter: Pkgs Jenkins <email address hidden>
Branch: mcp/ocata

Commit: 4ab11e89d00c7319cdfc376456495c7fa623673b
Author: Peter Razumovsky <email address hidden>
Date: Wed Apr 26 11:39:57 2017

Batching for tasks in scheduler

Add batch_size config for tasks in scheduler - now
only limited count of tasks can run in one time.

Change-Id: Ic1534038e4c067e5f72023e0b079f100320a93b2
Closes-bug: #1439675

[Fuel Devops McRobotson (fuel-devops-robot)]

Reviewed: https://review.fuel-infra.org/33484
Submitter: Pkgs Jenkins <email address hidden>
Branch: mcp/newton

Commit: e55d83b7e86ce7a57c2d2a2bc5abb5831d50c400
Author: Peter Razumovsky <email address hidden>
Date: Thu Apr 27 11:18:17 2017

Batching for tasks in scheduler

Add batch_size config for tasks in scheduler - now
only limited count of tasks can run in one time.

Change-Id: Ic1534038e4c067e5f72023e0b079f100320a93b2
Closes-bug: #1439675