etcd3gw.exceptions.Etcd3Exception: Not Found

[Radosław Piliszek]

This is reported upstream but notifying downstream here.

Link: https://github.com/dims/etcd3-gateway/issues/41

In the new release (0.2.6 from Jul 30, 2020)
~~etcd3gw is unable to raise (some?) of its own exceptions~~ (not true; the exception wording was mostly unfortunate and I guess we all fell in this trap)
(the truth is:) switched from /v3alpha to /v3beta endpoints which are not available on default etcd installations on current platforms (Ubuntu Bionic, Focal; CentOS 8):

Example:

2020-08-12 10:22:39.645 1787 ERROR oslo_service.service [-] Error starting thread.: etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service Traceback (most recent call last):
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_service/service.py", line 807, in run_service
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service service.start()
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/service.py", line 220, in start
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service coordination.COORDINATOR.start()
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/cinder/coordination.py", line 67, in start
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service self.coordinator.start(start_heart=True)
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/tooz/coordination.py", line 689, in start
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service super(CoordinationDriverWithExecutor, self).start(start_heart)
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/tooz/coordination.py", line 426, in start
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service self._start()
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/tooz/drivers/etcd3gw.py", line 224, in _start
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service self._membership_lease = self.client.lease(self.membership_timeout)
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/etcd3gw/client.py", line 122, in lease
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service json={"TTL": ttl, "ID": 0})
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service File "/var/lib/kolla/venv/lib/python3.6/site-packages/etcd3gw/client.py", line 91, in post
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service raise exceptions.Etcd3Exception(resp.text, resp.reason)
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-12 10:22:39.645 1787 ERROR oslo_service.service

[Radosław Piliszek (yoctozepto)]

Fixing via requirements blacklist: https://review.opendev.org/745835

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/755086

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/755086
Committed: https://git.openstack.org/cgit/openstack/tooz/commit/?id=3f0759091c9fddf4d1486188015fc526e66cd73e
Submitter: Zuul
Branch: master

commit 3f0759091c9fddf4d1486188015fc526e66cd73e
Author: Elod Illes <email address hidden>
Date: Tue Sep 29 18:46:25 2020 +0200

    Blacklist etcd3gw 0.2.6

    etcd3gw 0.2.6 was blacklisted in openstack/requirements [0], because
    that version has a bug [1].

    tooz does not use openstack/requirements' upper constraints, so the
    same blacklisting needs to be introduced here in setup.cfg.

    [0] Icb6873d8c5d3a3624c0ac3d76fc9125c5d8134b2
    [1] https://github.com/dims/etcd3-gateway/issues/41

    Change-Id: I22b955419014dd34c63e406c488e0636ffe9013b
    Closes-Bug: #1891314

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/victoria
Review: https://review.opendev.org/757711

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/757711
Committed: https://git.openstack.org/cgit/openstack/tooz/commit/?id=c8d77ee485746c4367528e542063d5a045c4b6f3
Submitter: Zuul
Branch: stable/victoria

commit c8d77ee485746c4367528e542063d5a045c4b6f3
Author: Elod Illes <email address hidden>
Date: Tue Sep 29 18:46:25 2020 +0200

    Blacklist etcd3gw 0.2.6

    etcd3gw 0.2.6 was blacklisted in openstack/requirements [0], because
    that version has a bug [1].

    tooz does not use openstack/requirements' upper constraints, so the
    same blacklisting needs to be introduced here in setup.cfg.

    [0] Icb6873d8c5d3a3624c0ac3d76fc9125c5d8134b2
    [1] https://github.com/dims/etcd3-gateway/issues/41

    Change-Id: I22b955419014dd34c63e406c488e0636ffe9013b
    Closes-Bug: #1891314
    (cherry picked from commit 3f0759091c9fddf4d1486188015fc526e66cd73e)

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ussuri
Review: https://review.opendev.org/759102

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tooz 2.3.1 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tooz 2.8.0 release.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/train
Review: https://review.opendev.org/c/openstack/tooz/+/792193

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tooz 2.7.2 release.

[OpenStack Infra (hudson-openstack)]

Change abandoned by "Stephen Finucane <email address hidden>" on branch: stable/train
Review: https://review.opendev.org/c/openstack/tooz/+/792193
Reason: This is done in https://review.opendev.org/c/openstack/tooz/+/848622/ now

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements yoga-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements victoria-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements wallaby-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements xena-eom release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/requirements zed-eom release.