A way to rate-limit executor submissions

[Joshua Harlow]

It would be nice to have a way to rate-limit submissions into an executor.

Typically executors that exist are based on a set of threads that consume work from a queue, producers of work submit work into that queue and get a future back to wait on, but the problem is that those queues that are used do not have bounds, and can go beyond a reasonable backlog that will never be able to be processed, so to avoid this situation it would be nice if there was some way to have a executor that self-rate-limited (to some degree).

[Joshua Harlow (harlowja)]

Review https://review.openstack.org/#/c/239780 has something along this line (with a hard-blocking limit) so it could be one such way of doing this...

[Ben Nemec (bnemec)]

Looks like the review was abandoned. Does this need to stay open?

[Joshua Harlow (harlowja)]

I don't think so, it doesn't seem like a high desire for it :-P