after host machine restart getting error hook failed: "update-status"

Bug #1966670 reported by Mukesh
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Etcd Charm
New
Undecided
Unassigned

Bug Description

etcd. hook failed: "update-status"

after control node ( host machine restart ) reboot etcd status show hook failed update-status

2022-03-28 08:59:51 INFO unit.etcd/1.juju-log server.go:327 Invoking reactive handler: reactive/etcd.py:153:prepare_tls_certificates
2022-03-28 08:59:51 INFO unit.etcd/1.juju-log server.go:327 Invoking reactive handler: reactive/etcd.py:264:set_db_ingress_address
2022-03-28 08:59:51 INFO unit.etcd/1.juju-log server.go:327 Invoking reactive handler: reactive/etcd.py:271:send_cluster_connection_details
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 cannot open cgroup hierarchy /sys/fs/cgroup/freezer: No such file or directory
2022-03-28 08:59:51 ERROR unit.etcd/1.juju-log server.go:327 Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-etcd-1/charm/reactive/etcd.py", line 296, in send_cluster_connection_details
    db.set_connection_string(connection_string, version=etcdctl.version())
  File "/var/lib/juju/agents/unit-etcd-1/charm/lib/etcdctl.py", line 193, in version
    out = check_output(
  File "/usr/lib/python3.8/subprocess.py", line 415, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/lib/python3.8/subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/snap/bin/etcd.etcdctl', 'version']' returned non-zero exit status 1.

2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 Traceback (most recent call last):
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/var/lib/juju/agents/unit-etcd-1/charm/hooks/update-status", line 22, in <module>
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 main()
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 bus.dispatch(restricted=restricted_mode)
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 _invoke(other_handlers)
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 handler.invoke()
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 self._action(*args)
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/var/lib/juju/agents/unit-etcd-1/charm/reactive/etcd.py", line 296, in send_cluster_connection_details
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 db.set_connection_string(connection_string, version=etcdctl.version())
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/var/lib/juju/agents/unit-etcd-1/charm/lib/etcdctl.py", line 193, in version
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 out = check_output(
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 415, in check_output
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 516, in run
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 raise CalledProcessError(retcode, process.args,
2022-03-28 08:59:51 WARNING unit.etcd/1.update-status logger.go:60 subprocess.CalledProcessError: Command '['/snap/bin/etcd.etcdctl', 'version']' returned non-zero exit status 1.
2022-03-28 08:59:51 ERROR juju.worker.uniter.operation runhook.go:146 hook "update-status" (via explicit, bespoke hook script) failed: exit status 1
2022-03-28 08:59:51 INFO juju.worker.uniter resolver.go:150 awaiting error resolution for "update-status" hook

work around is
 ssh to host machine
 lxc stop container
 lxc start container
ex:
sudo lxc stop juju-5e996e-1-lxd-9
sudo lxc start juju-5e996e-1-lxd-9

this make etcd staus active

Revision history for this message
George Kraft (cynerva) wrote :
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.