connection refused during deployment

[Marian Gasparovic]

focal ussuri OVS deployment, failed in etcd update-status hook

It is a one off failure, we have runs that finished openstack deployment

In the log I can see etcd cluster was not happy

2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: ['/snap/bin/etcd.etcdctl', 'cluster-health']
2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: {'ETCDCTL_API': '2', 'ETCDCTL_CA_FILE': '/var/snap/etcd/common/ca.crt', 'ETCDCTL_CERT_FILE': '/var/snap/etcd/common/server.crt', 'ETCDCTL_KEY_FILE': '/v
ar/snap/etcd/common/server.key'}
2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: b'cluster may be unhealthy: failed to list members\n'
2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: None
2021-11-25 00:49:40 WARNING unit.etcd/2.juju-log server.go:327 certificates:114: Notice: Unit failed cluster-health check
2021-11-25 00:49:40 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 Error: client: etcd cluster is unavailable or misconfigured; error #0: dial tcp 127.0.0.1:4001: connect: connection refused
2021-11-25 00:49:40 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 ; error #1: dial tcp 127.0.0.1:2379: connect: connection refused
2021-11-25 00:49:40 WARNING unit.etcd/2.certificates-relation-changed logger.go:60
2021-11-25 00:49:40 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 error #0: dial tcp 127.0.0.1:4001: connect: connection refused
2021-11-25 00:49:40 WARNING unit.etcd/2.certificates-relation-changed logger.go:60 error #1: dial tcp 127.0.0.1:2379: connect: connection refused
2021-11-25 00:49:40 WARNING unit.etcd/2.certificates-relation-changed logger.go:60
2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: ['/snap/bin/etcd.etcdctl', 'member', 'list']
2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: {'ETCDCTL_API': '2', 'ETCDCTL_CA_FILE': '/var/snap/etcd/common/ca.crt', 'ETCDCTL_CERT_FILE': '/var/snap/etcd/common/server.crt', 'ETCDCTL_KEY_FILE': '/v
ar/snap/etcd/common/server.key'}
2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: b''
2021-11-25 00:49:40 ERROR unit.etcd/2.juju-log server.go:327 certificates:114: None
2021-11-25 00:49:41 INFO unit.etcd/2.juju-log server.go:327 certificates:114: Invoking reactive handler: reactive/etcd.py:530:tls_state_control

juju crashdump
https://oil-jenkins.canonical.com/artifacts/3969c9a0-019f-4dfb-aaea-ce775c100ca2/generated/generated/openstack/juju-crashdump-openstack-2021-11-25-01.14.37.tar.gz

[Konstantinos Kaskavelis (kaskavel)]

Closing this due to inactivity (low number of occurrences, and no hit for more than one year)