Reboot plugin task fails deployment on CentOS

[Vyacheslav Struk]

CentOS deployment fails (ubuntu is ok) when "reboot" task is added to the tasks.yaml.
Node reboots successfully but deploy fails then.

How to reporoduce:

Create centos-based environment, create empty plugin with 'reboot' task:

- role: ['compute']
  stage: post_deployment
  type: reboot
  parameters:
      timeout: 720

Deploy it.

Unfortunately i have no diag snapshot or log files

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  openstack_version: "2014.2-6.1"
  api: "1.0"
  build_number: "307"
  build_id: "2015-04-12_12-50-24"
  nailgun_sha: "d4bef41e2e54a9415b8e3d5b572f9046010547a4"
  python-fuelclient_sha: "9208ff4a08dcb674ce2df132399a5aa3ddfac21c"
  astute_sha: "d96a80b63198a578b2c159edbd76048819039eb0"
  fuellib_sha: "867028fe78837dc2e4635a2cbb976782856964d0"
  ostf_sha: "c2a76a60ec4ebbd78e508216c2e12787bf25e423"
  fuelmain_sha: "8daac234aea6ac0a98f27871deec039f74f6fdab"

[Vladimir Sharshov (vsharshov)]

Hi, do you use image based provision in such cases? Can you check does this problem reproducing in case of classic provision?

[Vladimir Sharshov (vsharshov)]

This is potentially duplicate bug of https://bugs.launchpad.net/fuel/+bug/1441136

[Dmitry Pyzhov (dpyzhov)]

Please reopen this bug if it appears again

[Alex Schultz (alex-schultz)]

I was able to reproduce this.

[630] Error running RPC method granular_deploy: Failed to execute hook reboot_plugin-1.0.1.
---
uids:
- '4'
parameters:
  timeout: 360
priority: 800
fail_on_error: true
type: reboot
diagnostic_name: reboot_plugin-1.0.1
, trace:
["/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/nailgun_hooks.rb:54:in `block in process'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/nailgun_hooks.rb:26:in `each'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/nailgun_hooks.rb:26:in `process'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/deployment_engine/granular_deployment.rb:221:in `post_deployment_actions'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/deployment_engine.rb:71:in `deploy'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/orchestrator.rb:133:in `deploy_cluster'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/orchestrator.rb:56:in `granular_deploy'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/dispatcher.rb:111:in `granular_deploy'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/server.rb:142:in `dispatch_message'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/server.rb:103:in `block in dispatch'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/task_queue.rb:64:in `call'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/task_queue.rb:64:in `block in each'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/task_queue.rb:56:in `each'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/task_queue.rb:56:in `each'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/server.rb:101:in `each_with_index'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/server.rb:101:in `dispatch'",
 "/usr/lib64/ruby/gems/2.1.0/gems/astute-6.0.0/lib/astute/server/server.rb:85:in `block in perform_main_job'"]

[Alex Schultz (alex-schultz)]

Attached it he reboot plugin that I used. Basic install, centos, 1 controller, 1 compute node. Ran through the plugin debug instructions[0] and it failed.

[0] https://wiki.openstack.org/wiki/Fuel/Plugins#How_To:_Debug_deployment

[Alex Schultz (alex-schultz)]

Nevermind, I just figured out what was going on. This was failing because mcollective wasn't starting on reboot for the version I had deployed. I remembered that I had fixed that problem for bug 1445932 [0]. So that bug fix also fixes this issue and this bug should no longer be valid.

[0] https://bugs.launchpad.net/fuel/+bug/1445932

[Alex Schultz (alex-schultz)]

Sorry, wrong bug mentioned previously. The fix for mcollective was in bug 1443291.

[0] https://bugs.launchpad.net/fuel/+bug/1443291

[Alex Schultz (alex-schultz)]

Per a conversation with Dmitry Borodaenko, updating status to Fix Commited as this bug was fixed as part of the fix for the bug 1443291. The change review for this change is located at https://review.openstack.org/174005

[Vladimir Khlyunev (vkhlyunev)]

Verified on ISO 521