upgrade.sh scripts should wait until all upgraded containers are started

[Dennis Dmitriev]

Reproduced on CI test 'deploy_ha_after_upgrade_diagnostic-logs' :http://jenkins-product.srt.mirantis.net:8080/job/6.1.system_test.ubuntu.ceph_multinode_compact_neutron.upgrade/36/

Scenario:
    1) Install Fuel v6.0 admin node;
    2) Unpack fuel-6.1-upgrade-*.lrz to /var
    3) Start upgrade: '/var/upgrade.sh --no-rollback --password admin'

Upgrade script can fail after start the upgraded containers with the following error (http://paste.openstack.org/show/218066/) :

2015-05-09 04:04:34 ERROR 28299 (upgrade) OpenStackUpgrader: failed to upgrade: "502 Server Error: Bad Gateway"

Manual reproducing of the bug can be successful from time to time.

[Dmitry Pyzhov (dpyzhov)]

Root cause here is blinking of services in start.sh of containers. We should either extend our timeout or remove blinking.

[Matthew Mosesohn (raytrac3r)]

It seems we don't need to start nailgun during puppet run in order to do syncdb and upload_fixtures. I'll disable starting supervisord until the end of start.sh to prevent this weird upgrade issue.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/182246

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/182246
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=682eed618fbbb7b38d753a55672f50d599a2c441
Submitter: Jenkins
Branch: master

commit 682eed618fbbb7b38d753a55672f50d599a2c441
Author: Matthew Mosesohn <email address hidden>
Date: Tue May 12 14:33:58 2015 +0300

    Inhibit start of supervisord for nailgun

    Starting supervisord starts nailgun app too early
    before it is ready to serve requests. It will be
    started later in the docker container in the
    foreground. This prevents a race condition where
    DB upgrade takes place and nailgun is stopped.

    Change-Id: Icd27758f00e8f472041eb83019cb89dcb030afd1
    Closes-Bug: #1453400

[Maksym Strukov (unbelll)]

Verified as fixed in 6.1-432