The more workers working concurrently the less efficient python servers become, there is plenty of hard evidence backing that up. We have a fixed time budget for requests; its trivial to throw lots of work at loggerhead and make it slower and slower. We also have a front end that limits the concurrent requests, but if threads are not killed, then we can still have a thundering horde appear.
The more workers working concurrently the less efficient python servers become, there is plenty of hard evidence backing that up. We have a fixed time budget for requests; its trivial to throw lots of work at loggerhead and make it slower and slower. We also have a front end that limits the concurrent requests, but if threads are not killed, then we can still have a thundering horde appear.