Comment 3 for bug 1248757

I do see these in the console log though:

"Dropping user packet because connection is dead"

That's had 15 hits in the last 7 days:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRHJvcHBpbmcgdXNlciBwYWNrZXQgYmVjYXVzZSBjb25uZWN0aW9uIGlzIGRlYWRcIiBBTkQgZmlsZW5hbWU6XCJjb25zb2xlLmh0bWxcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTM4Njg4NDM0ODA1NH0=

Also seeing this:

"EOF in transport thread"

150 hits in the last 7 days on that, 100% fail rates for the builds that shows up in:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRU9GIGluIHRyYW5zcG9ydCB0aHJlYWRcIiBBTkQgZmlsZW5hbWU6XCJjb25zb2xlLmh0bWxcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTM4Njg4NTAxNzA4NX0=

Looks like that one is probably due to bug 1253896.

When 'EOF in transport thread' shows up, 'Dropping user packet because connection is dead' doesn't, so 'Dropping user packet because connection is dead' might be the best to write an e-r query against right now.

Alternatively maybe we could check on "timeout=self.timeout, pkey=self.pkey", that shows up 26 times in the last 7 days, all fails:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwidGltZW91dD1zZWxmLnRpbWVvdXQsIHBrZXk9c2VsZi5wa2V5XCIgQU5EIGZpbGVuYW1lOlwiY29uc29sZS5odG1sXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjYwNDgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjEzODY4ODUyOTQwNTl9