Integrity checker is too greedy

[Renat Akhmerov]

Workflow execution integrity checker may be too aggressive in case of a very big long running workflow. When a big workflow is running it may have many task executions in RUNNING state at the same time and the checker tries to process them all at once in a single transaction, so, in fact, it may block normal action completion processing for a significant period of time, even causing DB deadlocks (by timeout).

It makes sense to use batches when running this mechanism.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/615720
Committed: https://git.openstack.org/cgit/openstack/mistral/commit/?id=3b4136ff1eb27472cb6d2ee4d1603e2b92f22ac9
Submitter: Zuul
Branch: master

commit 3b4136ff1eb27472cb6d2ee4d1603e2b92f22ac9
Author: Renat Akhmerov <email address hidden>
Date: Tue Nov 6 11:17:38 2018 +0700

    Add batch size for integrity checker

    * Added the new property 'execution_integrity_check_batch_size'
      under the [engine] group to limit the number of task executions
      that the integrity checker may process during one iteration.

    Closes-Bug: #1801876
    Change-Id: I3c5074c45c476ebff109617cb15d56c54575dd4f

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/rocky
Review: https://review.openstack.org/617126

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/617126
Committed: https://git.openstack.org/cgit/openstack/mistral/commit/?id=d8b19e93773a096d9eabc4d0427f8c061d2fa06f
Submitter: Zuul
Branch: stable/rocky

commit d8b19e93773a096d9eabc4d0427f8c061d2fa06f
Author: Renat Akhmerov <email address hidden>
Date: Tue Nov 6 11:17:38 2018 +0700

    Add batch size for integrity checker

    * Added the new property 'execution_integrity_check_batch_size'
      under the [engine] group to limit the number of task executions
      that the integrity checker may process during one iteration.

    Closes-Bug: #1801876
    Change-Id: I3c5074c45c476ebff109617cb15d56c54575dd4f
    (cherry picked from commit 3b4136ff1eb27472cb6d2ee4d1603e2b92f22ac9)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/mistral 8.0.0.0b1 development milestone.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/mistral 7.1.0 release.