In testrun https://solutions.qa.canonical.com/v2/testruns/8e7c2530-9cd7-4d87-a7d6-aa51ff91d370, which is part of the lma candidate release, failed when a nagios check on grafana fails:
```
Exception: Errors found in nagios validation:
- check: check-ntpmon
id: '154'
results:
check-output: 'CRITICAL: No sync peer selected | frequency=-5.648000 offset=-0.000029
peers=20 reach=100.000000 result=2 rootdelay=0.085089 rootdisp=0.036175 runtime=1448
stratum=4 sync=0.000000 sysjitter= sysoffset=0.000013675 tracehosts= traceloops=
tracetime='
return-code: 0
status: completed
timing:
completed: 2023-01-26 15:41:37 +0000 UTC
enqueued: 2023-01-26 15:41:35 +0000 UTC
started: 2023-01-26 15:41:36 +0000 UTC
unit: nrpe/5
```
The only thing standing out in the grafana logs is an pip installation error:
```
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Attempting uninstall: MarkupSafe
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Found existing installation: MarkupSafe 2.0.1
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Uninstalling MarkupSafe-2.0.1:
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Successfully uninstalled MarkupSafe-2.0.1
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Attempting uninstall: idna
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Found existing installation: idna 2.8
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Not uninstalling idna at /usr/lib/python3/dist-packages, outside environment /var/lib/juju/agents/unit-grafana-0/.venv
juju/unit-grafana-0.log-2023-01-26 15:14:01 DEBUG unit.grafana/0.install logger.go:60 Can't uninstall 'idna'. No files were found to uninstall.
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Attempting uninstall: certifi
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Found existing installation: certifi 2019.11.28
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Not uninstalling certifi at /usr/lib/python3/dist-packages, outside environment /var/lib/juju/agents/unit-grafana-0/.venv
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Can't uninstall 'certifi'. No files were found to uninstall.
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Attempting uninstall: requests
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Found existing installation: requests 2.22.0
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Not uninstalling requests at /usr/lib/python3/dist-packages, outside environment /var/lib/juju/agents/unit-grafana-0/.venv
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Can't uninstall 'requests'. No files were found to uninstall.
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Attempting uninstall: Jinja2
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Found existing installation: Jinja2 2.10.1
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Not uninstalling jinja2 at /usr/lib/python3/dist-packages, outside environment /var/lib/juju/agents/unit-grafana-0/.venv
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Can't uninstall 'Jinja2'. No files were found to uninstall.
juju/unit-grafana-0.log:2023-01-26 15:14:02 WARNING unit.grafana/0.install logger.go:60 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
juju/unit-grafana-0.log-2023-01-26 15:14:02 WARNING unit.grafana/0.install logger.go:60 launchpadlib 1.10.13 requires testresources, which is not installed.
juju/unit-grafana-0.log-2023-01-26 15:14:02 DEBUG unit.grafana/0.install logger.go:60 Successfully installed Jinja2-2.11.3 MarkupSafe-2.0.1 PyYAML-5.3.1 certifi-2022.12.7 chardet-3.0.4 charmhelpers-1.2.1 charms.reactive-1.5.1 flit-core-3.8.0 idna-2.10 jsondiff-2.0.0 netaddr-0.7.19 pbr-5.11.1 pyaml-21.10.1 requests-2.24.0 six-1.16.0 tenacity-5.0.3 urllib3-1.25.11
```
The crashdump can be found here:
https://oil-jenkins.canonical.com/artifacts/8e7c2530-9cd7-4d87-a7d6-aa51ff91d370/generated/generated/lma-maas/juju-crashdump-lma-maas-2023-01-26-15.43.16.tar.gz
Other logs and configs here:
https://oil-jenkins.canonical.com/artifacts/8e7c2530-9cd7-4d87-a7d6-aa51ff91d370/index.html
check-ntpmon is actually checking ntp, not grafana. I will move the bug.