Comment 2 for bug 1338608

Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

Actual problem is here: looks like puppet timeout. This is related to nova-network - not ceilometer. Logs are showing that nova-api is functioning, haproxy is working, keystone is issuing tokens. Not sure where the problem may be. Need a reproducer or more logs. Keeping as new for a while.

2014-07-06T02:10:24.562529+00:00 err: Could not run: execution expired
2014-07-06T02:10:24.562865+00:00 err: /usr/lib/ruby/1.8/timeout.rb:64:in `rbuf_fill'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/1.8/net/protocol.rb:134:in `rbuf_fill'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/1.8/net/protocol.rb:116:in `readuntil'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/1.8/net/protocol.rb:126:in `readline'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/1.8/net/http.rb:2028:in `read_status_line'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/1.8/net/http.rb:2017:in `read_new'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/1.8/net/http.rb:1051:in `request'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/1.8/net/http.rb:845:in `post'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/vendor_ruby/openstack/connection.rb:305:in `initialize'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/vendor_ruby/openstack/connection.rb:261:in `new'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/vendor_ruby/openstack/connection.rb:261:in `init'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/vendor_ruby/openstack/compute/connection.rb:12:in `initialize'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/vendor_ruby/openstack/connection.rb:66:in `new'
2014-07-06T02:10:24.563714+00:00 err: /usr/lib/ruby/vendor_ruby/openstack/connection.rb:66:in `create'
2014-07-06T02:10:24.563714+00:00 err: /etc/puppet/modules/nova/lib/puppet/provider/nova_floating_range/nova_manage.rb:68:in `connect'
2014-07-06T02:10:24.563991+00:00 err: /etc/puppet/modules/nova/lib/puppet/provider/nova_floating_range/nova_manage.rb:49:in `operate_range'
2014-07-06T02:10:24.563991+00:00 err: /etc/puppet/modules/nova/lib/puppet/provider/nova_floating_range/nova_manage.rb:15:in `exists?'
2014-07-06T02:10:24.563991+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/property/ensure.rb:81:in `retrieve'
2014-07-06T02:10:24.563991+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/type.rb:1035:in `retrieve'
2014-07-06T02:10:24.563991+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/type.rb:1063:in `retrieve_resource'
2014-07-06T02:10:24.563991+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:223:in `from_resource'
2014-07-06T02:10:24.564997+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction/resource_harness.rb:17:in `evaluate'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:174:in `apply'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:187:in `eval_resource'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `call'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `evaluate'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util.rb:327:in `thinmark'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/1.8/benchmark.rb:308:in `realtime'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util.rb:326:in `thinmark'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `evaluate'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/graph/relationship_graph.rb:118:in `traverse'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:108:in `evaluate'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:164:in `apply'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util/log.rb:149:in `with_destination'
2014-07-06T02:10:24.565799+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/transaction/report.rb:108:in `as_logging_destination'
2014-07-06T02:10:24.566003+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:163:in `apply'
2014-07-06T02:10:24.566003+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:125:in `apply_catalog'
2014-07-06T02:10:24.566003+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util.rb:161:in `benchmark'
2014-07-06T02:10:24.566713+00:00 err: /usr/lib/ruby/1.8/benchmark.rb:308:in `realtime'
2014-07-06T02:10:24.567782+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util.rb:160:in `benchmark'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:124:in `apply_catalog'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:192:in `run'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:268:in `apply_catalog'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:218:in `main'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:146:in `run_command'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/application.rb:470:in `plugin_hook'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util.rb:478:in `exit_on_fail'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:137:in `run'
2014-07-06T02:10:24.567944+00:00 err: /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:91:in `execute'
2014-07-06T02:10:24.567944+00:00 err: /usr/bin/puppet:4