Scenario:
1. Revert snapshot 'base_deploy_3_ctrl_1_cmp'
2. Set local snapshot repo as default for environment
3. Add 1 node with controller role
4. Run network verification
5. Deploy changes
Expected result: deployment is successful.
Actual result: deployment failed. Not all deployments tasks completed.
Task name: rabbitmq Status: error
Errors from puppet.log:
2017-04-02 01:02:47 +0000 /Stage[main]/Nova::Rabbitmq/Rabbitmq_user[nova] (err): Could not evaluate: Execution of '/usr/sbin/rabbitmqctl -q list_users' returned 70: Error: rabbit application is not running on node rabbit@messaging-node-2.
* Suggestion: start it with "rabbitmqctl start_app" and try again
/usr/lib/ruby/vendor_ruby/puppet/util/execution.rb:219:in `execute'
2017-04-02 01:06:42 +0000 /Stage[main]/Nova::Rabbitmq/Rabbitmq_vhost[/] (err): Could not evaluate: Command is still failing after 180 seconds expired!
/etc/puppet/modules/rabbitmq/lib/puppet/provider/rabbitmqctl.rb:30:in `run_with_retries'
2017-04-02 01:10:26 +0000 Puppet (err): Execution of '/usr/sbin/rabbitmqctl eval rabbit_access_control:check_user_pass_login(list_to_binary("nova"), list_to_binary("ZdQjXalK2IuOshn8X51tkZlG")).' returned 70: Error: {badarg,[{rabbit_misc,dirty_read,1,[]},
{xmerl_uri,module_info,1,[]},
{lists,foldl,3,[]},
{xmerl_uri,module_info,1,[]},
{rpc,'-handle_call_call/6-fun-0-',5,[]},
{xmerl_uri,module_info,1,[]}]}
/usr/lib/ruby/vendor_ruby/puppet/util/execution.rb:219:in `execute'
2017-04-02 01:10:26 +0000 /Stage[main]/Nova::Rabbitmq/Rabbitmq_user[nova]/password (err): change from to ZdQjXalK2IuOshn8X51tkZlG failed: Execution of '/usr/sbin/rabbitmqctl eval rabbit_access_control:check_user_pass_login(list_to_binary("nova"), list_to_binary("ZdQjXalK2IuOshn8X51tkZlG")).' returned 70: Error: {badarg,[{rabbit_misc,dirty_read,1,[]},
{xmerl_uri,module_info,1,[]},
{lists,foldl,3,[]},
{xmerl_uri,module_info,1,[]},
{rpc,'-handle_call_call/6-fun-0-',5,[]},
{xmerl_uri,module_info,1,[]}]}
Note that this bug may be a duplicate of #1674637 and #1674637 actually not fixed