Couchbase manager doesn't wait for service to be ready before running node-init

[Mat Lowery]

2014-05-30 17:40:09.694 987 DEBUG trove.openstack.common.processutils [req-c240147a-3b7c-44eb-b0d3-0bb275d13752 f9eef30f097d40e28370726c2878e1c4 ac5d8df358d94e5a8763b4e8fc97b793 - - -] Running cmd (subpro
cess): sudo /opt/couchbase/bin/couchbase-cli node-init -c 10.9.204.101:8091 --node-init-data-path=/var/lib/couchbase -u root -p EdFcWAN9JAZXXjbwuHeyYp4zZ3gqeyfCcqzK execute /home/ubuntu/trove/trove/openst
ack/common/processutils.py:137
2014-05-30 17:40:09.871 987 DEBUG trove.openstack.common.processutils [req-c240147a-3b7c-44eb-b0d3-0bb275d13752 f9eef30f097d40e28370726c2878e1c4 ac5d8df358d94e5a8763b4e8fc97b793 - - -] Result was 1 execut
e /home/ubuntu/trove/trove/openstack/common/processutils.py:162
2014-05-30 17:40:09.872 987 ERROR trove.guestagent.datastore.couchbase.service [req-c240147a-3b7c-44eb-b0d3-0bb275d13752 f9eef30f097d40e28370726c2878e1c4 ac5d8df358d94e5a8763b4e8fc97b793 - - -] Process ex
ecution error Unexpected error while running command.
Command: sudo /opt/couchbase/bin/couchbase-cli node-init -c 10.9.204.101:8091 --node-init-data-path=/var/lib/couchbase -u root -p EdFcWAN9JAZXXjbwuHeyYp4zZ3gqeyfCcqzK
Exit code: 1
Stdout: 'ERROR: command: node-init: 10.9.204.101:8091, [Errno 111] Connection refused\n'
Stderr: ''
2014-05-30 17:40:09.872 987 ERROR trove.openstack.common.rpc.amqp [req-c240147a-3b7c-44eb-b0d3-0bb275d13752 f9eef30f097d40e28370726c2878e1c4 ac5d8df358d94e5a8763b4e8fc97b793 - - -] Exception during messag
e handling
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp Traceback (most recent call last):
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp File "/home/ubuntu/trove/trove/openstack/common/rpc/amqp.py", line 440, in _process_data
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp **args)
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp File "/home/ubuntu/trove/trove/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp File "/home/ubuntu/trove/trove/guestagent/datastore/couchbase/manager.py", line 78, in prepare
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp self.app.install_if_needed(packages)
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp File "/home/ubuntu/trove/trove/guestagent/datastore/couchbase/service.py", line 61, in install_if_needed
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp self.initial_setup()
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp File "/home/ubuntu/trove/trove/guestagent/datastore/couchbase/service.py", line 88, in initial_setup
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp raise RuntimeError("Couchbase Server initial setup failed")
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp RuntimeError: Couchbase Server initial setup failed
2014-05-30 17:40:09.872 987 TRACE trove.openstack.common.rpc.amqp

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/97566

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/97566
Committed: https://git.openstack.org/cgit/openstack/trove/commit/?id=e634d471d276f8ac53aed9b36f669a7c4f7766d3
Submitter: Jenkins
Branch: master

commit e634d471d276f8ac53aed9b36f669a7c4f7766d3
Author: Mat Lowery <email address hidden>
Date: Mon Jun 2 15:07:38 2014 -0500

    Wait for Couchbase to be ready before node-init

    Changes:
    * Make install_if_needed consistent with MongoDB
    * Don't run node-init as part of install_if_needed
    * Start Couchbase and poll until ready before node-init

    Closes-Bug: #1325753
    Change-Id: I1bbb616b6ec2eb6b83faa30f597a6331421542fb