Fuel for OpenStack

Looks like ceilometer attempts to start before mongo service is ready

Bug #1429863 reported by Maxim V. Yefimov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
Undecided
Maxim V. Yefimov
Fuel for OpenStack 6.1

Bug Description

The ceilometer-dbsync fails with no suitable hosts found.

env:
7node
3 (controller + mongo)
1 compute
3 ceph osd
deploy juno on ubuntu
on dell R620
network card:
one public network
one PXE
LACP bind four network card as one ovs-bond for Private, storage and management

The following error occure in puppet :

2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/bin/puppet:4
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:91:in `execute'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util/command_line.rb:137:in `run'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util.rb:478:in `exit_on_fail'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/application.rb:470:in `plugin_hook'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/application.rb:364:in `run'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:146:in `run_command'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:218:in `main'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/application/apply.rb:268:in `apply_catalog'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:192:in `run'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:124:in `apply_catalog'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util.rb:160:in `benchmark'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/1.8/benchmark.rb:308:in `realtime'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util.rb:161:in `benchmark'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/configurer.rb:125:in `apply_catalog'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:163:in `apply'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/report.rb:108:in `as_logging_destination'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util/log.rb:149:in `with_destination'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/resource/catalog.rb:164:in `apply'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:108:in `evaluate'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/graph/relationship_graph.rb:118:in `traverse'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `evaluate'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util.rb:326:in `thinmark'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/1.8/benchmark.rb:308:in `realtime'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util.rb:327:in `thinmark'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `evaluate'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:117:in `call'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction.rb:191:in `eval_resource'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/event_manager.rb:19:in `process_events'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/event_manager.rb:92:in `queued_events'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/event_manager.rb:92:in `each'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/event_manager.rb:93:in `queued_events'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/event_manager.rb:20:in `process_events'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/event_manager.rb:101:in `process_callback'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/transaction/event_manager.rb:101:in `send'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/type/exec.rb:537:in `refresh'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/type/exec.rb:120:in `sync'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) /usr/lib/ruby/vendor_ruby/puppet/util/errors.rb:97:in `fail'
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) ceilometer-dbsync --config-file=/etc/ceilometer/ceilometer.conf returned 1 instead of one of [0]
2015-02-12 12:41:55 ERR
(/Stage[main]/Ceilometer::Db/Exec[ceilometer-dbsync]) Failed to call refresh: ceilometer-dbsync --config-file=/etc/ceilometer/ceilometer.conf returned 1 instead of one of [0]

MongoDB status:

>rs.status()
{
"startupStatus" : 3,
"info" : "run rs.initiate(...) if not yet done for the set",
"ok" : 0,
"errmsg" : "can't get local.system.replset config from self or any seed (EMPTYCONFIG)"
}

> show dbs
admin (empty)
local 0.078125GB

Looks like Mongodb cluster was not created.

Revision history for this message
Ryan Moe (rmoe) wrote :

Maxim, can you please provide a diagnostic snapshot?

Changed in fuel:
status: New → Incomplete
milestone: none → 6.1
assignee: nobody → Maxim V. Yefimov (mefimov)
Revision history for this message
Alexander Bozhenko (alexbozhenko) wrote :

Look like root cause of this bug is
https://bugs.launchpad.net/fuel/+bug/1424919

Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

Can you please provide information about ISO that you've used?

Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

I can't reproduce this bug on 226 and next ISO's, so I mark this bug as invalid.

Changed in fuel:
status: Incomplete → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.