radosgw initialization failed if OSDs are not available during 5 minutes

[Anatolii Neliubin]

Detailed bug description:
  RadosGW cannot start if OSDs are not available
Steps to reproduce:
  Install fresh MOS 7 with a controllet and OSD nodes. Shutdown the whole cluster, start a controller, but do not start OSD nodes. In five minutes RadosGW will fail to initialize.
Expected results:
  RadosGW should wait until OSDs are available
Actual result:
  RadosGW stops with a message in a log file: "Initialization timeout, failed to initialize"
Reproducibility:
 Reproduced in MOS 7
Workaround:
  to increase rgw_init_timeout in /etc/ceph/ceph.conf
Impact:
  RGW service can be left in stopped state after reboot of a cluster.
Description of the environment:
 Operation system: Ubuntu 14.04
 Reference architecture: ceph controller + ceph OSD nodes
Additional information:
   https://bugs.launchpad.net/charms/+source/ceph-radosgw/+bug/1577519

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/333961

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/333961
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=41ac7b9f650d3cef3a267607f067c4097ea01fb3
Submitter: Jenkins
Branch: master

commit 41ac7b9f650d3cef3a267607f067c4097ea01fb3
Author: Oleksiy Molchanov <email address hidden>
Date: Fri Jun 24 18:15:04 2016 +0300

    Add rgw_init_timeout for radosgw

    Add rgw_init_timeout parameter for radosgw to ceph.conf in order to
    extend timeout for starting service while waiting for OSD nodes.

    Change-Id: I1b7f4445d7199ad7700f33e833340d91a02e9573
    Closes-Bug: 1590093

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/348401

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/357890

[OpenStack Infra (hudson-openstack)]

Change abandoned by Oleksiy Molchanov (<email address hidden>) on branch: stable/mitaka
Review: https://review.openstack.org/348401
Reason: https://review.openstack.org/#/c/357890/

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/357896

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/7.0
Review: https://review.openstack.org/357897

[OpenStack Infra (hudson-openstack)]

Change abandoned by Oleksiy Molchanov (<email address hidden>) on branch: stable/mitaka
Review: https://review.openstack.org/357890

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/348401
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=e59d23d14cb2ff6cceeb0ad9bda1ad5952b93696
Submitter: Jenkins
Branch: stable/mitaka

commit e59d23d14cb2ff6cceeb0ad9bda1ad5952b93696
Author: Oleksiy Molchanov <email address hidden>
Date: Thu Jul 28 17:46:49 2016 +0300

    Add rgw_init_timeout for radosgw

    Add rgw_init_timeout parameter for radosgw to ceph.conf in order to
    extend timeout for starting service while waiting for OSD nodes.

    Change-Id: Ic2ffdba2217a2f820816d2e7ec71a26b31b05114
    Closes-Bug: 1590093

[TatyanaGladysheva (tgladysheva)]

Verified on 9.1 snapshot #226.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/357896
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=4eb3b13969d16c5ccb2858cc8f0f563eff69c335
Submitter: Jenkins
Branch: stable/8.0

commit 4eb3b13969d16c5ccb2858cc8f0f563eff69c335
Author: Oleksiy Molchanov <email address hidden>
Date: Thu Jul 28 17:46:49 2016 +0300

    Add rgw_init_timeout for radosgw

    Add rgw_init_timeout parameter for radosgw to ceph.conf in order to
    extend timeout for starting service while waiting for OSD nodes.

    Change-Id: I1b7f4445d7199ad7700f33e833340d91a02e9573
    Closes-Bug: 1590093

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/357897
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=47fb8470377f5e3d6af670c850394ec92e29fc04
Submitter: Jenkins
Branch: stable/7.0

commit 47fb8470377f5e3d6af670c850394ec92e29fc04
Author: Oleksiy Molchanov <email address hidden>
Date: Thu Jul 28 17:46:49 2016 +0300

    Add rgw_init_timeout for radosgw

    Add rgw_init_timeout parameter for radosgw to ceph.conf in order to
    extend timeout for starting service while waiting for OSD nodes.

    Change-Id: I1b7f4445d7199ad7700f33e833340d91a02e9573
    Closes-Bug: 1590093

[TatyanaGladysheva (tgladysheva)]

Verified on MOS 7.0 + MU6 updates.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-library 10.0.0rc1 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-library 10.0.0 release.

[TatyanaGladysheva (tgladysheva)]

Verified on 8.0 + MU4 updates.

[TatyanaGladysheva (tgladysheva)]

Verified on 10.0 build #1569.