2019-03-01 13:32:41 WARNING juju-log cluster:29: min-cluster-size is not defined, race conditions may occur if this is not a single unit deployment.
2019-03-01 13:32:43 INFO juju.worker.uniter.operation runhook.go:138 ran "cluster-relation-changed" hook
2019-03-01 13:33:18 DEBUG juju-log Hardening function 'update_status'
2019-03-01 13:33:18 DEBUG juju-log No hardening applied to 'update_status'
2019-03-01 13:33:18 INFO juju-log Updating status.
2019-03-01 13:33:22 DEBUG juju-log check_cluster_memberships(): 'rabbit@landscapeamqp-1' in nodes but not in charm relations or running_nodes, telling RabbitMQ to forget about it.
2019-03-01 13:33:24 DEBUG juju-log Running ['/usr/sbin/rabbitmqctl', 'forget_cluster_node', 'rabbit@landscapeamqp-1']
2019-03-01 13:33:25 DEBUG update-status Removing node 'rabbit@landscapeamqp-1' from cluster
2019-03-01 13:33:25 DEBUG update-status Error: {failed_to_remove_node,'rabbit@landscapeamqp-1',
2019-03-01 13:33:25 DEBUG update-status {active,"Mnesia is running",
2019-03-01 13:33:25 DEBUG update-status 'rabbit@landscapeamqp-1'}}
2019-03-01 13:33:25 DEBUG update-status Traceback (most recent call last):
2019-03-01 13:33:25 DEBUG update-status File "/var/lib/juju/agents/unit-landscape-rabbitmq-server-1/charm/hooks/update-status", line 957, in <module>
2019-03-01 13:33:25 DEBUG update-status hooks.execute(sys.argv)
2019-03-01 13:33:25 DEBUG update-status File "/var/lib/juju/agents/unit-landscape-rabbitmq-server-1/charm/charmhelpers/core/hookenv.py", line 909, in execute
2019-03-01 13:33:25 DEBUG update-status self._hooks[hook_name]()
2019-03-01 13:33:25 DEBUG update-status File "/var/lib/juju/agents/unit-landscape-rabbitmq-server-1/charm/charmhelpers/contrib/hardening/harden.py", line 93, in _harden_inner2
2019-03-01 13:33:25 DEBUG update-status return f(*args, **kwargs)
2019-03-01 13:33:25 DEBUG update-status File "/var/lib/juju/agents/unit-landscape-rabbitmq-server-1/charm/hooks/update-status", line 953, in update_status
2019-03-01 13:33:25 DEBUG update-status rabbit.check_cluster_memberships()
2019-03-01 13:33:25 DEBUG update-status File "/var/lib/juju/agents/unit-landscape-rabbitmq-server-1/charm/hooks/rabbit_utils.py", line 512, in check_cluster_memberships
2019-03-01 13:33:25 DEBUG update-status forget_cluster_node(node)
2019-03-01 13:33:25 DEBUG update-status File "/var/lib/juju/agents/unit-landscape-rabbitmq-server-1/charm/hooks/rabbit_utils.py", line 522, in forget_cluster_node
2019-03-01 13:33:25 DEBUG update-status rabbitmqctl('forget_cluster_node', node)
2019-03-01 13:33:25 DEBUG update-status File "/var/lib/juju/agents/unit-landscape-rabbitmq-server-1/charm/hooks/rabbit_utils.py", line 348, in rabbitmqctl
2019-03-01 13:33:25 DEBUG update-status subprocess.check_call(cmd)
2019-03-01 13:33:25 DEBUG update-status File "/usr/lib/python3.6/subprocess.py", line 291, in check_call
2019-03-01 13:33:25 DEBUG update-status raise CalledProcessError(retcode, cmd)
2019-03-01 13:33:25 DEBUG update-status subprocess.CalledProcessError: Command '['/usr/sbin/rabbitmqctl', 'forget_cluster_node', 'rabbit@landscapeamqp-1']' returned non-zero exit status 70.
2019-03-01 13:33:25 ERROR juju.worker.uniter.operation runhook.go:132 hook "update-status" failed: exit status 1
2019-03-01 13:33:25 INFO juju.worker.uniter resolver.go:124 awaiting error resolution for "update-status" hook
2019-03-01 13:33:27 INFO juju.worker.uniter resolver.go:124 awaiting error resolution for "update-status" hook
2019-03-01 13:33:30 INFO juju.worker.uniter resolver.go:124 awaiting error resolution for "update-status" hook
Full crash-dump logs