Zaqar subscriptions failed to report deployment error

[Thomas Herve]

Seen on this ci run, still trying to understand what's going on: http://logs.openstack.org/01/513701/3/gate/legacy-tripleo-ci-centos-7-scenario004-multinode-oooq/d5013a0/

We can see the error here: http://logs.openstack.org/01/513701/3/gate/legacy-tripleo-ci-centos-7-scenario004-multinode-oooq/d5013a0/logs/undercloud/var/log/zaqar/zaqar.log.txt.gz#_2017-10-25_09_31_07_869

Failed to establish a new connection: [Errno 111] Connection refused',)).: ConnectionError: HTTPConnectionPool(host='centos-7-vexxhost-ca-ymq-1-0000443726', port=35533): Max retries exceeded with url: /44c18acd-a129-4933-b60e-7402bd25e598

I wonder if it may be a IPv6 misbehavior.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/515123

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/515123
Committed: https://git.openstack.org/cgit/openstack/instack-undercloud/commit/?id=5fdb4d7913bfc0096c725f6f99fd98e949c75d58
Submitter: Zuul
Branch: master

commit 5fdb4d7913bfc0096c725f6f99fd98e949c75d58
Author: Thomas Herve <email address hidden>
Date: Wed Oct 25 18:17:06 2017 +0200

    Set notification_bind on zaqar websocket

    Don't let zaqar websocket listen to notifications on all interfaces:
    otherwise, it uses the hostname as a subscription target, and it doesn't
    work when the host is set as an IPv6 host. Ultimately this should be
    fixed in Zaqar, but this will work around it for now.

    Change-Id: I78e0671024b93ec64740cd7a8cda227a5145b789
    Related-Bug: #1727406

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/pike
Review: https://review.openstack.org/515290

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/515290
Committed: https://git.openstack.org/cgit/openstack/instack-undercloud/commit/?id=211eb5bc6c4a019e0b70c99697cc66614f68c1d1
Submitter: Zuul
Branch: stable/pike

commit 211eb5bc6c4a019e0b70c99697cc66614f68c1d1
Author: Thomas Herve <email address hidden>
Date: Wed Oct 25 18:17:06 2017 +0200

    Set notification_bind on zaqar websocket

    Don't let zaqar websocket listen to notifications on all interfaces:
    otherwise, it uses the hostname as a subscription target, and it doesn't
    work when the host is set as an IPv6 host. Ultimately this should be
    fixed in Zaqar, but this will work around it for now.

    Change-Id: I78e0671024b93ec64740cd7a8cda227a5145b789
    Related-Bug: #1727406
    (cherry picked from commit 5fdb4d7913bfc0096c725f6f99fd98e949c75d58)

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/516983

[Martin André (mandre)]

We're still seing it in CI, see https://bugs.launchpad.net/tripleo/+bug/1730179.

Hopefully https://review.openstack.org/#/c/517889/ should fix it for good.

[Martin André (mandre)]

Removing the alert tag, https://review.openstack.org/#/c/517889/ was merged in both master and stable/pike.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/516983
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=41a319490178c5bb72d7559ea211c013984f0ae8
Submitter: Zuul
Branch: master

commit 41a319490178c5bb72d7559ea211c013984f0ae8
Author: Dan Prince <email address hidden>
Date: Wed Nov 1 08:49:01 2017 -0400

    Set notification_bind on zaqar websocket

    Don't let zaqar websocket listen to notifications on all interfaces:
    otherwise, it uses the hostname as a subscription target, and it doesn't
    work when the host is set as an IPv6 host. Ultimately this should be
    fixed in Zaqar, but this will work around it for now.

    Change-Id: Ib7ece313371660ea02bef314bf5b5d2c4121a884
    Related-Bug: #1727406