etcd crashes with panic every couple hours

[Jérôme Poulin]

This crash happens every coupls hours at a random point.

When one etcd crashes with panic: send on closed channel, all the other etcd in the cluster do the same.

An issue opened on github etcd seems to point toward the version shipped in Bionic.

https://github.com/etcd-io/etcd/issues/9956

ProblemType: Bug
DistroRelease: Ubuntu 18.04
Package: etcd 3.2.17+dfsg-1
ProcVersionSignature: Ubuntu 4.15.0-36.39-generic 4.15.18
Uname: Linux 4.15.0-36-generic x86_64
ApportVersion: 2.20.9-0ubuntu7.3
Architecture: amd64
Date: Wed Oct 31 22:58:23 2018
PackageArchitecture: all
ProcEnviron:
 TERM=xterm-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_CA.UTF-8
 SHELL=/bin/bash
SourcePackage: etcd
UpgradeStatus: No upgrade log present (probably fresh install)

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Rodion Tikunov (rtikunov)]

Without TLS enabled it works perfectly.

[Tiit Pikma (thsnr)]

This issue can (at least partially) be resolved by upgrading golang-google-grpc to version 1.7.0. It includes a fix for https://github.com/etcd-io/etcd/issues/8627, which the author of this issue reported as the problem in https://github.com/etcd-io/etcd/issues/9956.

See my comment here: https://github.com/etcd-io/etcd/issues/9956#issuecomment-472355078.