Another failure https://ci.fuel-infra.org/job/11.0-community.main.ubuntu.bvt_2/659/
node-4-10.109.5.6/var/log/haproxy.log """ 2017-04-11T20:14:43.095944+00:00 node-4 haproxy[4265]: Server object-storage/node-4 is DOWN, reason: Layer7 wrong status, code: 503, info: "Service Unavailable", check duration: 0ms. 2 active and 0 backup servers left. 0 sessions active, 0 requeued, 0 remaining in queue. """
And never got UP status.
fuel/var/log/remote/10.109.5.6/radosgw.log
Shows the same symptoms: """ 2017-04-11T20:09:42.151654+00:00 info: 2017-04-11 20:09:42.093482 7f4b656cca00 0 librados: client.radosgw.gateway authentication error (1) Operation not permitted 2017-04-11T20:09:42.151654+00:00 info: 2017-04-11 20:09:42.094659 7f4b656cca00 -1 Couldn't init storage provider (RADOS) 2017-04-11T20:09:42.151654+00:00 info: 2017-04-11 20:09:42.094659 7f4b656cca00 -1 Couldn't init storage provider (RADOS) ... 2017-04-11T20:14:38.907272+00:00 info: 2017-04-11 20:14:38.906112 7f9e83fdf700 1 handle_sigterm 2017-04-11T20:14:38.907272+00:00 info: 2017-04-11 20:14:38.906179 7f9e83fdf700 1 handle_sigterm set alarm for 120 2017-04-11T20:14:38.923333+00:00 info: 2017-04-11 20:14:38.919726 7f9efa287a00 -1 shutting down 2017-04-11T20:14:38.932722+00:00 info: 2017-04-11 20:14:38.919726 7f9efa287a00 -1 shutting down 2017-04-11T20:14:38.932722+00:00 info: 2017-04-11 20:14:38.926414 7f9e83fdf700 1 handle_sigterm 2017-04-11T20:14:38.932722+00:00 info: 2017-04-11 20:14:38.931703 7f9e837de700 0 ERROR: FCGX_Accept_r returned -4 2017-04-11T20:14:39.172599+00:00 info: 2017-04-11 20:14:39.169010 7f9efa287a00 1 final shutdown """
http://paste.openstack.org/show/606555/
Another failure https:/ /ci.fuel- infra.org/ job/11. 0-community. main.ubuntu. bvt_2/659/
node-4- 10.109. 5.6/var/ log/haproxy. log 11T20:14: 43.095944+ 00:00 node-4 haproxy[4265]: Server object- storage/ node-4 is DOWN, reason: Layer7 wrong status, code: 503, info: "Service Unavailable", check duration: 0ms. 2 active and 0 backup servers left. 0 sessions active, 0 requeued, 0 remaining in queue.
"""
2017-04-
"""
And never got UP status.
fuel/var/ log/remote/ 10.109. 5.6/radosgw. log
Shows the same symptoms: 11T20:09: 42.151654+ 00:00 info: 2017-04-11 20:09:42.093482 7f4b656cca00 0 librados: client. radosgw. gateway authentication error (1) Operation not permitted 11T20:09: 42.151654+ 00:00 info: 2017-04-11 20:09:42.094659 7f4b656cca00 -1 Couldn't init storage provider (RADOS) 11T20:09: 42.151654+ 00:00 info: 2017-04-11 20:09:42.094659 7f4b656cca00 -1 Couldn't init storage provider (RADOS) 11T20:14: 38.907272+ 00:00 info: 2017-04-11 20:14:38.906112 7f9e83fdf700 1 handle_sigterm 11T20:14: 38.907272+ 00:00 info: 2017-04-11 20:14:38.906179 7f9e83fdf700 1 handle_sigterm set alarm for 120 11T20:14: 38.923333+ 00:00 info: 2017-04-11 20:14:38.919726 7f9efa287a00 -1 shutting down 11T20:14: 38.932722+ 00:00 info: 2017-04-11 20:14:38.919726 7f9efa287a00 -1 shutting down 11T20:14: 38.932722+ 00:00 info: 2017-04-11 20:14:38.926414 7f9e83fdf700 1 handle_sigterm 11T20:14: 38.932722+ 00:00 info: 2017-04-11 20:14:38.931703 7f9e837de700 0 ERROR: FCGX_Accept_r returned -4 11T20:14: 39.172599+ 00:00 info: 2017-04-11 20:14:39.169010 7f9efa287a00 1 final shutdown
"""
2017-04-
2017-04-
2017-04-
...
2017-04-
2017-04-
2017-04-
2017-04-
2017-04-
2017-04-
2017-04-
"""
http:// paste.openstack .org/show/ 606555/