Comment 7 for bug 1693339

Revision history for this message
Pradeep Kilambi (pkilambi) wrote :

There are other issues i'm seeing wit the env, so hard to pin point its gnocchi issue:

oslo messaging rabbitmq seems down:

=ERROR REPORT==== 22-Jun-2017::15:08:04 ===
Error on AMQP connection <0.2189.0> (172.16.2.11:40606 -> 172.16.2.6:5672 - neutron-l3-agent:123624:03f21b1f-62e1-4064-97dc-a7ecda757487, vhost: '/', user: 'guest', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"

=INFO REPORT==== 22-Jun-2017::15:08:05 ===
Stopped RabbitMQ application

=INFO REPORT==== 22-Jun-2017::15:08:44 ===
Stopping RabbitMQ

=INFO REPORT==== 22-Jun-2017::15:08:44 ===
Stopped RabbitMQ application

=INFO REPORT==== 22-Jun-2017::15:08:44 ===
Halting Erlang VM

in swift logs i see:

Jun 22 17:30:48 localhost proxy-server: STDERR: ERROR:oslo.messaging._drivers.impl_rabbit:[2f7e7090-9278-4824-b491-20b8dcc5c403] AMQP server on overcloud-controller-1.internalapi.localdomain:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds. Client port: None

so without seift functioning properly gnocchi and wont and inturn ceilo will fail.

marking as incomplete as i'm not sure where the root cause is yet.