AT&T: Parallel requests over the same socket connection.

[Ben Kietzman]

AT&T has requested an enhancement. They have various connections setup to interface with the Service Junction. The connections stay up 24x7. Multiple requests are sent on the socket. Each request is handled using FIFO logic. There is a concern that requests could become backlogged on the socket.

[Ben Kietzman (ben-kietzman)]

A possible solution would be to add a keyword to the first line of every request that would trigger the Service Junction to handle that request in parallel instead of FIFO. Then if the keyword exists, multiple incoming requests would be handled in parallel and their associated responses would have the possibility of being written back in mixed order.

FIFO vs parallel request handling would be triggered based on the keyword in the first line of each request. So if there were three incoming requests where the first and third requests had the keyword and the second did not, then in essence the first two requests would run at the same time while the third request would have to wait until the second completed.

[Ben Kietzman (ben-kietzman)]

Added the new logic. The new keyword is "ProcessType". Setting the field to "parallel" will trigger the new logic for that particular request. The new logic is now in a soak period to make sure no bugs were introduced.