wait for grafana ready failed

[lei zhang]

- which kolla version you are using
  master
- what's the install type and distro
  source、centos
- where and when the kolla image is built?
  pull from dockerhub

When kolla deploying grafana, it will check whether grafana's login URL. After serval times deploy tests, I find some times it check failed. But after an interval, I can open the grafana's login page.

TASK [grafana : Wait for grafana application ready] **************************************************************************************************************************************************************
FAILED - RETRYING: Wait for grafana application ready (10 retries left).
FAILED - RETRYING: Wait for grafana application ready (9 retries left).
FAILED - RETRYING: Wait for grafana application ready (8 retries left).
FAILED - RETRYING: Wait for grafana application ready (7 retries left).
FAILED - RETRYING: Wait for grafana application ready (6 retries left).
FAILED - RETRYING: Wait for grafana application ready (5 retries left).
FAILED - RETRYING: Wait for grafana application ready (4 retries left).
FAILED - RETRYING: Wait for grafana application ready (3 retries left).
FAILED - RETRYING: Wait for grafana application ready (2 retries left).
FAILED - RETRYING: Wait for grafana application ready (1 retries left).
fatal: [localhost]: FAILED! => {"attempts": 10, "changed": false, "content": "", "msg": "Status code was -1 and not [200]: Request failed: <urlopen error [Errno 111] 拒绝连接>", "redirected": false, "status": -1, "url": "http://192.168.132.9:3000/login"}

NO MORE HOSTS LEFT ***********************************************************************************************************************************************************************************************
 to retry, use: --limit @/root/kolla-ansible/ansible/site.retry

PLAY RECAP *******************************************************************************************************************************************************************************************************
localhost : ok=405 changed=234 unreachable=0 failed=1

I think we should increase the delay of this task to prevent from such issue.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/645496

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/645496
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=20ef211f6a045ebfdf786564b6af3936345bbdc3
Submitter: Zuul
Branch: master

commit 20ef211f6a045ebfdf786564b6af3936345bbdc3
Author: chenxing <email address hidden>
Date: Fri Mar 22 15:54:13 2019 +0800

    Increase retries numbers of grafana check task

    20 seconds may be too short to wait for grafana ready, Let's keep the
    check task 60 seconds.

    backport: rocky

    Change-Id: Ib219ad215d1ef2147ba3591f8c398feb4f3c8888
    Closes-Bug: #1821285

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/655524

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/655632

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/655524
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=2a673b31154e4c5e6f57d400a20c0053c232a500
Submitter: Zuul
Branch: stable/stein

commit 2a673b31154e4c5e6f57d400a20c0053c232a500
Author: chenxing <email address hidden>
Date: Fri Mar 22 15:54:13 2019 +0800

    Increase retries numbers of grafana check task

    20 seconds may be too short to wait for grafana ready, Let's keep the
    check task 60 seconds.

    backport: rocky

    Change-Id: Ib219ad215d1ef2147ba3591f8c398feb4f3c8888
    Closes-Bug: #1821285
    (cherry picked from commit 20ef211f6a045ebfdf786564b6af3936345bbdc3)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/655632
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=1f655ed9c901aa4d72629a80d29354e7d949f90a
Submitter: Zuul
Branch: stable/rocky

commit 1f655ed9c901aa4d72629a80d29354e7d949f90a
Author: chenxing <email address hidden>
Date: Fri Mar 22 15:54:13 2019 +0800

    Increase retries numbers of grafana check task

    20 seconds may be too short to wait for grafana ready, Let's keep the
    check task 60 seconds.

    backport: rocky

    Change-Id: Ib219ad215d1ef2147ba3591f8c398feb4f3c8888
    Closes-Bug: #1821285
    (cherry picked from commit 20ef211f6a045ebfdf786564b6af3936345bbdc3)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 7.1.1 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 8.0.0.0rc2 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 9.0.0.0rc1 release candidate.