Comment 8 for bug 1916672

Revision history for this message
Xav Paice (xavpaice) wrote :

is this fix available in cs:~openstack-charmers-next/percona-cluster-393? I'm getting slightly different errors now:

2021-04-20 10:05:16 [INFO] Executing changes:
2021-04-20 10:05:16 [INFO] - upload charm cs:~openstack-charmers-next/percona-cluster-393 for series xenial
2021-04-20 10:05:20 [INFO] - deploy application mysql on xenial using cs:~openstack-charmers-next/percona-cluster-393
2021-04-20 10:05:21 [INFO] - upload charm cs:nagios-43 for series xenial
2021-04-20 10:05:24 [INFO] - deploy application nagios on xenial using cs:nagios-43
2021-04-20 10:05:25 [INFO] - upload charm /home/xav/charms/charm-nrpe/.build/nrpe for series xenial
2021-04-20 10:05:39 [INFO] - deploy application nrpe on xenial using /home/xav/charms/charm-nrpe/.build/nrpe
2021-04-20 10:05:40 [INFO] - add relation mysql:nrpe-external-master - nrpe:nrpe-external-master
2021-04-20 10:05:40 [INFO] - add relation nrpe:monitors - nagios:monitors
2021-04-20 10:05:41 [INFO] - add unit mysql/0 to new machine 0
2021-04-20 10:05:41 [INFO] - add unit nagios/0 to new machine 1
2021-04-20 10:05:42 [INFO] Deploy of bundle completed.
2021-04-20 10:05:42 [INFO] Waiting for environment to settle
2021-04-20 10:05:42 [INFO] Timeout for deployment to settle set to: 3600
2021-04-20 10:05:45 [INFO] Waiting for a unit to appear
2021-04-20 10:05:45 [INFO] Waiting for all units to be idle
2021-04-20 10:09:39 [ERROR] {'default_alias': 'zaza-4f1033787dfe'}
2021-04-20 10:09:39 [ERROR] Model default_alias (zaza-4f1033787dfe)
2021-04-20 10:09:44 [ERROR] Applications in error state: mysql
2021-04-20 10:09:44 [ERROR] Units in error state: mysql/0
2021-04-20 10:09:44 [ERROR] Juju log for mysql/0
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined Traceback (most recent call last):
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined File "/var/lib/juju/agents/unit-mysql-0/charm/hooks/nrpe-external-master-relation-joined", line 1235, in <module>
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined main()
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined File "/var/lib/juju/agents/unit-mysql-0/charm/hooks/nrpe-external-master-relation-joined", line 1225, in main
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined hooks.execute(sys.argv)
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined File "/var/lib/juju/agents/unit-mysql-0/charm/charmhelpers/core/hookenv.py", line 956, in execute
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined self._hooks[hook_name]()
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined File "/var/lib/juju/agents/unit-mysql-0/charm/hooks/nrpe-external-master-relation-joined", line 1098, in update_nrpe_config
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined set_nagios_user()
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined File "/var/lib/juju/agents/unit-mysql-0/charm/hooks/percona_utils.py", line 1837, in set_nagios_user
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined create_nagios_user()
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined File "/var/lib/juju/agents/unit-mysql-0/charm/hooks/percona_utils.py", line 1831, in create_nagios_user
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined m_helper.set_mysql_password('nagios', nagios_password())
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined File "/var/lib/juju/agents/unit-mysql-0/charm/charmhelpers/contrib/database/mysql.py", line 362, in set_mysql_password
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined 'leader settings (%s)') % ex, ex)
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 WARNING nrpe-external-master-relation-joined charmhelpers.contrib.database.mysql.MySQLSetPasswordError: ('Cannot connect using password in leader settings ((1045, "Access denied for user \'nagios\'@\'localhost\' (using password: YES)"))', OperationalError(1045, "Access denied for user 'nagios'@'localhost' (using password: YES)"))
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 ERROR juju.worker.uniter.operation runhook.go:139 hook "nrpe-external-master-relation-joined" (via explicit, bespoke hook script) failed: exit status 1
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:38 INFO juju.worker.uniter resolver.go:143 awaiting error resolution for "relation-joined" hook
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log: 2021-04-19 22:09:46 INFO juju.worker.uniter resolver.go:143 awaiting error resolution for "relation-joined" hook
2021-04-20 10:09:52 [ERROR] unit-mysql-0.log:
Traceback (most recent call last):
  File "/home/xav/charms/charm-nrpe/.tox/func/bin/functest-run-suite", line 8, in <module>
    sys.exit(main())
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/charm_lifecycle/func_test_runner.py", line 308, in main
    func_test_runner(
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/charm_lifecycle/func_test_runner.py", line 242, in func_test_runner
    run_env_deployment(env_deployment, keep_model=preserve_model,
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/charm_lifecycle/func_test_runner.py", line 122, in run_env_deployment
    deploy.deploy(
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/charm_lifecycle/deploy.py", line 385, in deploy
    zaza.model.wait_for_application_states(
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/__init__.py", line 77, in _wrapper
    return run(_run_it())
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/__init__.py", line 62, in run
    return task.result()
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/__init__.py", line 76, in _run_it
    return await f(*args, **kwargs)
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/model.py", line 1203, in async_wait_for_application_states
    await block_until_auto_reconnect_model(
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/model.py", line 290, in block_until_auto_reconnect_model
    await asyncio.wait_for(_block(), timeout, loop=loop)
  File "/usr/lib/python3.8/asyncio/tasks.py", line 483, in wait_for
    return fut.result()
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/model.py", line 282, in _block
    result = _done()
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/model.py", line 251, in _done
    return all(c() for c in conditions)
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/model.py", line 251, in <genexpr>
    return all(c() for c in conditions)
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/model.py", line 1204, in <lambda>
    lambda: check_model_for_hard_errors(
  File "/home/xav/charms/charm-nrpe/.tox/func/lib/python3.8/site-packages/zaza/model.py", line 1065, in check_model_for_hard_errors
    raise UnitError(errored_units)
zaza.model.UnitError: Units mysql/0 in error state