2022-08-01 20:39:26 INFO juju unit_agent.go:278 Starting unit workers for "ceph-fs/0"
2022-08-01 20:39:26 INFO juju.worker.apicaller connect.go:163 [84d213] "unit-ceph-fs-0" successfully connected to "18.220.161.133:17070"
2022-08-01 20:39:26 INFO juju.worker.apicaller connect.go:260 [84d213] password changed for "unit-ceph-fs-0"
2022-08-01 20:39:26 INFO juju.worker.apicaller connect.go:163 [84d213] "unit-ceph-fs-0" successfully connected to "172.31.14.112:17070"
2022-08-01 20:39:26 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE
2022-08-01 20:39:26 INFO juju.worker.logger logger.go:120 logger worker started
2022-08-01 20:39:26 DEBUG juju.worker.dependency engine.go:578 "hook-retry-strategy" manifold worker started at 2022-08-01 20:39:26.361268951 +0000 UTC
2022-08-01 20:39:26 INFO juju.worker.upgrader upgrader.go:219 no waiter, upgrader is done
2022-08-01 20:39:26 DEBUG juju.worker.dependency engine.go:601 "upgrader" manifold worker completed successfully
2022-08-01 20:39:26 DEBUG juju.worker.dependency engine.go:578 "uniter" manifold worker started at 2022-08-01 20:39:26.3789435 +0000 UTC
2022-08-01 20:39:26 DEBUG juju.worker.dependency engine.go:578 "metric-sender" manifold worker started at 2022-08-01 20:39:26.379028081 +0000 UTC
2022-08-01 20:39:26 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher
2022-08-01 20:39:26 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[18.220.161.133:17070 172.31.14.112:17070 252.14.112.1:17070 127.0.0.1:17070 [::1]:17070]]
2022-08-01 20:39:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed)
2022-08-01 20:39:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed)
2022-08-01 20:39:26 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:39:26 ERROR juju.worker.meterstatus runner.go:91 error running "meter-status-changed": charm missing from disk
2022-08-01 20:39:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:39:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed)
2022-08-01 20:39:26 DEBUG juju.worker.uniter uniter.go:860 starting local juju-run listener on {unix /var/lib/juju/agents/unit-ceph-fs-0/run.socket <nil>}
2022-08-01 20:39:26 INFO juju.worker.uniter uniter.go:329 unit "ceph-fs/0" started
2022-08-01 20:39:26 DEBUG juju.worker.uniter runlistener.go:118 juju-run listener running
2022-08-01 20:39:26 INFO juju.worker.uniter uniter.go:630 resuming charm install
2022-08-01 20:39:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation install ch:amd64/focal/ceph-fs-36 for ceph-fs/0
2022-08-01 20:39:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install ch:amd64/focal/ceph-fs-36" for ceph-fs/0
2022-08-01 20:39:26 INFO juju.worker.uniter.charm bundles.go:78 downloading ch:amd64/focal/ceph-fs-36 from API server
2022-08-01 20:39:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install ch:amd64/focal/ceph-fs-36" for ceph-fs/0
2022-08-01 20:39:26 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "ch:amd64/focal/ceph-fs-36"
2022-08-01 20:39:26 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "ch:amd64/focal/ceph-fs-36"
2022-08-01 20:39:27 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "ch:amd64/focal/ceph-fs-36"
2022-08-01 20:39:27 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install ch:amd64/focal/ceph-fs-36" for ceph-fs/0
2022-08-01 20:39:27 INFO juju.worker.uniter uniter.go:347 hooks are retried true
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:498 got application change for ceph-fs/0
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:594 got action change for ceph-fs/0: [] ok=true
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:602 got relations change for ceph-fs/0: ok=true
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:573 got address change for ceph-fs/0: ok=true, hashes=[293b0e2ef0027fb7011a939c19a1880d53cd7444e1e5aceededa299362475305]
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:563 got upgrade series change
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:713 no upgrade series in progress, reinitializing local upgrade series state
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:612 got storage change for ceph-fs/0: [] ok=true
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:541 got config change for ceph-fs/0: ok=true, hashes=[60c79018878e4cee492e4cbe668a78d8c43f353ed26e459245262e669a3018bc]
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:488 got unit change for ceph-fs/0
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:584 got leader settings change for ceph-fs/0: ok=true
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:622 got update status interval change for ceph-fs/0: ok=true
2022-08-01 20:39:27 DEBUG juju.worker.uniter.remotestate watcher.go:552 got trust config change for ceph-fs/0: ok=true, hashes=[15b3fbb2dff76fa867e5ddfaf25522ae4ccb1b732fbd92ded9855974904d2a71]
2022-08-01 20:39:27 INFO juju.worker.uniter.storage resolver.go:127 initial storage attachments ready
2022-08-01 20:39:27 INFO juju.worker.uniter resolver.go:148 found queued "install" hook
2022-08-01 20:39:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for ceph-fs/0
2022-08-01 20:39:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run install hook)
2022-08-01 20:39:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run install hook)
2022-08-01 20:39:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for ceph-fs/0
2022-08-01 20:39:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for ceph-fs/0
2022-08-01 20:39:27 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running install hook
2022-08-01 20:39:27 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:39:28 DEBUG unit.ceph-fs/0.juju-log server.go:319 Running the apt-get install command as .is-git-installed not set
2022-08-01 20:39:28 DEBUG unit.ceph-fs/0.install logger.go:60 Reading package lists...
2022-08-01 20:39:28 DEBUG unit.ceph-fs/0.install logger.go:60 Building dependency tree...
2022-08-01 20:39:28 DEBUG unit.ceph-fs/0.install logger.go:60 Reading state information...
2022-08-01 20:39:28 DEBUG unit.ceph-fs/0.install logger.go:60 git is already the newest version (1:2.25.1-1ubuntu3.5).
2022-08-01 20:39:28 DEBUG unit.ceph-fs/0.install logger.go:60 git set to manually installed.
2022-08-01 20:39:28 DEBUG unit.ceph-fs/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Reading package lists...
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Building dependency tree...
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Reading state information...
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1).
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1).
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 python3-yaml set to manually installed.
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 The following additional packages will be installed:
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   binutils binutils-common binutils-x86-64-linux-gnu cpp cpp-9 dpkg-dev
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   fakeroot g++ g++-9 gcc gcc-9 gcc-9-base libalgorithm-diff-perl
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libalgorithm-diff-xs-perl libalgorithm-merge-perl libasan5 libatomic1
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libbinutils libc-dev-bin libc6-dev libcc1-0 libcrypt-dev libctf-nobfd0
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libctf0 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libgcc-9-dev libgomp1 libisl22 libitm1 liblsan0 libmpc3 libpython3-dev
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libpython3.8-dev libquadmath0 libstdc++-9-dev libtsan0 libubsan1
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   linux-libc-dev make manpages-dev python-pip-whl python3.8-dev zlib1g-dev
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Suggested packages:
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   binutils-doc cpp-doc gcc-9-locales debian-keyring g++-multilib
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   g++-9-multilib gcc-9-doc gcc-multilib autoconf automake libtool flex bison
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   gdb gcc-doc gcc-9-multilib glibc-doc bzr libstdc++-9-doc make-doc
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 The following NEW packages will be installed:
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   binutils binutils-common binutils-x86-64-linux-gnu build-essential cpp cpp-9
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   dpkg-dev fakeroot g++ g++-9 gcc gcc-9 gcc-9-base libalgorithm-diff-perl
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libalgorithm-diff-xs-perl libalgorithm-merge-perl libasan5 libatomic1
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libbinutils libc-dev-bin libc6-dev libcc1-0 libcrypt-dev libctf-nobfd0
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libctf0 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libgcc-9-dev libgomp1 libisl22 libitm1 liblsan0 libmpc3 libpython3-dev
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   libpython3.8-dev libquadmath0 libstdc++-9-dev libtsan0 libubsan1
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   linux-libc-dev make manpages-dev python-pip-whl python3-dev python3-pip
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60   python3-wheel python3.8-dev zlib1g-dev
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 0 upgraded, 50 newly installed, 0 to remove and 0 not upgraded.
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Need to get 52.2 MB of archives.
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 After this operation, 228 MB of additional disk space will be used.
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:1 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 binutils-common amd64 2.34-6ubuntu1.3 [207 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:2 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libbinutils amd64 2.34-6ubuntu1.3 [474 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:3 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libctf-nobfd0 amd64 2.34-6ubuntu1.3 [47.4 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:4 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libctf0 amd64 2.34-6ubuntu1.3 [46.6 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:5 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 binutils-x86-64-linux-gnu amd64 2.34-6ubuntu1.3 [1613 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:6 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 binutils amd64 2.34-6ubuntu1.3 [3380 B]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:7 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libc-dev-bin amd64 2.31-0ubuntu9.9 [71.8 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:8 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-libc-dev amd64 5.4.0-122.138 [1105 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:9 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libcrypt-dev amd64 1:4.4.10-10ubuntu4 [104 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:10 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libc6-dev amd64 2.31-0ubuntu9.9 [2519 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:11 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 gcc-9-base amd64 9.4.0-1ubuntu1~20.04.1 [19.4 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:12 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libisl22 amd64 0.22.1-1 [592 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:13 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libmpc3 amd64 1.1.0-1 [40.8 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:14 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 cpp-9 amd64 9.4.0-1ubuntu1~20.04.1 [7500 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:15 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 cpp amd64 4:9.3.0-1ubuntu2 [27.6 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:16 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libcc1-0 amd64 10.3.0-1ubuntu1~20.04 [48.8 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:17 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libgomp1 amd64 10.3.0-1ubuntu1~20.04 [102 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:18 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libitm1 amd64 10.3.0-1ubuntu1~20.04 [26.2 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:19 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libatomic1 amd64 10.3.0-1ubuntu1~20.04 [9284 B]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:20 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libasan5 amd64 9.4.0-1ubuntu1~20.04.1 [2751 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:21 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 liblsan0 amd64 10.3.0-1ubuntu1~20.04 [835 kB]
2022-08-01 20:39:29 DEBUG unit.ceph-fs/0.install logger.go:60 Get:22 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libtsan0 amd64 10.3.0-1ubuntu1~20.04 [2009 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:23 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libubsan1 amd64 10.3.0-1ubuntu1~20.04 [784 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:24 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libquadmath0 amd64 10.3.0-1ubuntu1~20.04 [146 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:25 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libgcc-9-dev amd64 9.4.0-1ubuntu1~20.04.1 [2359 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:26 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 gcc-9 amd64 9.4.0-1ubuntu1~20.04.1 [8274 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:27 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 gcc amd64 4:9.3.0-1ubuntu2 [5208 B]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:28 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libstdc++-9-dev amd64 9.4.0-1ubuntu1~20.04.1 [1722 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:29 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 g++-9 amd64 9.4.0-1ubuntu1~20.04.1 [8420 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:30 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 g++ amd64 4:9.3.0-1ubuntu2 [1604 B]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:31 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 make amd64 4.2.1-1.2 [162 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:32 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libdpkg-perl all 1.19.7ubuntu3.2 [231 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:33 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 dpkg-dev all 1.19.7ubuntu3.2 [679 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:34 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 build-essential amd64 12.8ubuntu1.1 [4664 B]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:35 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libfakeroot amd64 1.24-1 [25.7 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:36 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 fakeroot amd64 1.24-1 [62.6 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:37 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-diff-perl all 1.19.03-2 [46.6 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:38 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-diff-xs-perl amd64 0.04-6 [11.3 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:39 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-merge-perl all 0.08-3 [12.0 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:40 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libexpat1-dev amd64 2.2.9-1ubuntu0.4 [117 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:41 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libfile-fcntllock-perl amd64 0.22-3build4 [33.1 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:42 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libpython3.8-dev amd64 3.8.10-0ubuntu1~20.04.5 [3951 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:43 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libpython3-dev amd64 3.8.2-0ubuntu2 [7236 B]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:44 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 manpages-dev all 5.05-1 [2266 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:45 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/universe amd64 python-pip-whl all 20.0.2-5ubuntu1.6 [1805 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:46 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-2ubuntu1.3 [155 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:47 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 python3.8-dev amd64 3.8.10-0ubuntu1~20.04.5 [514 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:48 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 python3-dev amd64 3.8.2-0ubuntu2 [1212 B]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:49 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/universe amd64 python3-wheel all 0.34.2-1 [23.8 kB]
2022-08-01 20:39:30 DEBUG unit.ceph-fs/0.install logger.go:60 Get:50 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-pip all 20.0.2-5ubuntu1.6 [231 kB]
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Fetched 52.2 MB in 1s (43.9 MB/s)
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package binutils-common:amd64.
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 (Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 61785 files and directories currently installed.)
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../00-binutils-common_2.34-6ubuntu1.3_amd64.deb ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking binutils-common:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libbinutils:amd64.
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../01-libbinutils_2.34-6ubuntu1.3_amd64.deb ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libbinutils:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libctf-nobfd0:amd64.
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../02-libctf-nobfd0_2.34-6ubuntu1.3_amd64.deb ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libctf-nobfd0:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libctf0:amd64.
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../03-libctf0_2.34-6ubuntu1.3_amd64.deb ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libctf0:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package binutils-x86-64-linux-gnu.
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../04-binutils-x86-64-linux-gnu_2.34-6ubuntu1.3_amd64.deb ...
2022-08-01 20:39:31 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking binutils-x86-64-linux-gnu (2.34-6ubuntu1.3) ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package binutils.
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../05-binutils_2.34-6ubuntu1.3_amd64.deb ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking binutils (2.34-6ubuntu1.3) ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libc-dev-bin.
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../06-libc-dev-bin_2.31-0ubuntu9.9_amd64.deb ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libc-dev-bin (2.31-0ubuntu9.9) ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package linux-libc-dev:amd64.
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../07-linux-libc-dev_5.4.0-122.138_amd64.deb ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking linux-libc-dev:amd64 (5.4.0-122.138) ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libcrypt-dev:amd64.
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../08-libcrypt-dev_1%3a4.4.10-10ubuntu4_amd64.deb ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libcrypt-dev:amd64 (1:4.4.10-10ubuntu4) ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libc6-dev:amd64.
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../09-libc6-dev_2.31-0ubuntu9.9_amd64.deb ...
2022-08-01 20:39:32 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libc6-dev:amd64 (2.31-0ubuntu9.9) ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package gcc-9-base:amd64.
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../10-gcc-9-base_9.4.0-1ubuntu1~20.04.1_amd64.deb ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking gcc-9-base:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libisl22:amd64.
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../11-libisl22_0.22.1-1_amd64.deb ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libisl22:amd64 (0.22.1-1) ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libmpc3:amd64.
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../12-libmpc3_1.1.0-1_amd64.deb ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libmpc3:amd64 (1.1.0-1) ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package cpp-9.
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../13-cpp-9_9.4.0-1ubuntu1~20.04.1_amd64.deb ...
2022-08-01 20:39:33 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking cpp-9 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package cpp.
2022-08-01 20:39:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../14-cpp_4%3a9.3.0-1ubuntu2_amd64.deb ...
2022-08-01 20:39:34 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking cpp (4:9.3.0-1ubuntu2) ...
2022-08-01 20:39:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libcc1-0:amd64.
2022-08-01 20:39:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../15-libcc1-0_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:34 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libcc1-0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libgomp1:amd64.
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../16-libgomp1_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libgomp1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libitm1:amd64.
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../17-libitm1_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libitm1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libatomic1:amd64.
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../18-libatomic1_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libatomic1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libasan5:amd64.
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../19-libasan5_9.4.0-1ubuntu1~20.04.1_amd64.deb ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libasan5:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package liblsan0:amd64.
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../20-liblsan0_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking liblsan0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libtsan0:amd64.
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../21-libtsan0_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libtsan0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libubsan1:amd64.
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../22-libubsan1_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libubsan1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libquadmath0:amd64.
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../23-libquadmath0_10.3.0-1ubuntu1~20.04_amd64.deb ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libquadmath0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libgcc-9-dev:amd64.
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../24-libgcc-9-dev_9.4.0-1ubuntu1~20.04.1_amd64.deb ...
2022-08-01 20:39:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libgcc-9-dev:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:37 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package gcc-9.
2022-08-01 20:39:37 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../25-gcc-9_9.4.0-1ubuntu1~20.04.1_amd64.deb ...
2022-08-01 20:39:37 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking gcc-9 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package gcc.
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../26-gcc_4%3a9.3.0-1ubuntu2_amd64.deb ...
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking gcc (4:9.3.0-1ubuntu2) ...
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libstdc++-9-dev:amd64.
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../27-libstdc++-9-dev_9.4.0-1ubuntu1~20.04.1_amd64.deb ...
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libstdc++-9-dev:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package g++-9.
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../28-g++-9_9.4.0-1ubuntu1~20.04.1_amd64.deb ...
2022-08-01 20:39:38 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking g++-9 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package g++.
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../29-g++_4%3a9.3.0-1ubuntu2_amd64.deb ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking g++ (4:9.3.0-1ubuntu2) ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package make.
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../30-make_4.2.1-1.2_amd64.deb ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking make (4.2.1-1.2) ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libdpkg-perl.
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../31-libdpkg-perl_1.19.7ubuntu3.2_all.deb ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libdpkg-perl (1.19.7ubuntu3.2) ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package dpkg-dev.
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../32-dpkg-dev_1.19.7ubuntu3.2_all.deb ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking dpkg-dev (1.19.7ubuntu3.2) ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package build-essential.
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../33-build-essential_12.8ubuntu1.1_amd64.deb ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking build-essential (12.8ubuntu1.1) ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libfakeroot:amd64.
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../34-libfakeroot_1.24-1_amd64.deb ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libfakeroot:amd64 (1.24-1) ...
2022-08-01 20:39:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package fakeroot.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../35-fakeroot_1.24-1_amd64.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking fakeroot (1.24-1) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libalgorithm-diff-perl.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../36-libalgorithm-diff-perl_1.19.03-2_all.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libalgorithm-diff-perl (1.19.03-2) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libalgorithm-diff-xs-perl.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../37-libalgorithm-diff-xs-perl_0.04-6_amd64.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libalgorithm-diff-xs-perl (0.04-6) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libalgorithm-merge-perl.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../38-libalgorithm-merge-perl_0.08-3_all.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libalgorithm-merge-perl (0.08-3) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libexpat1-dev:amd64.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../39-libexpat1-dev_2.2.9-1ubuntu0.4_amd64.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libexpat1-dev:amd64 (2.2.9-1ubuntu0.4) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libfile-fcntllock-perl.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../40-libfile-fcntllock-perl_0.22-3build4_amd64.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libfile-fcntllock-perl (0.22-3build4) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libpython3.8-dev:amd64.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../41-libpython3.8-dev_3.8.10-0ubuntu1~20.04.5_amd64.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04.5) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libpython3-dev:amd64.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../42-libpython3-dev_3.8.2-0ubuntu2_amd64.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libpython3-dev:amd64 (3.8.2-0ubuntu2) ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package manpages-dev.
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../43-manpages-dev_5.05-1_all.deb ...
2022-08-01 20:39:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking manpages-dev (5.05-1) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python-pip-whl.
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../44-python-pip-whl_20.0.2-5ubuntu1.6_all.deb ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python-pip-whl (20.0.2-5ubuntu1.6) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package zlib1g-dev:amd64.
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../45-zlib1g-dev_1%3a1.2.11.dfsg-2ubuntu1.3_amd64.deb ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu1.3) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3.8-dev.
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../46-python3.8-dev_3.8.10-0ubuntu1~20.04.5_amd64.deb ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3.8-dev (3.8.10-0ubuntu1~20.04.5) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-dev.
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../47-python3-dev_3.8.2-0ubuntu2_amd64.deb ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-dev (3.8.2-0ubuntu2) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-wheel.
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../48-python3-wheel_0.34.2-1_all.deb ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-wheel (0.34.2-1) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-pip.
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../49-python3-pip_20.0.2-5ubuntu1.6_all.deb ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-pip (20.0.2-5ubuntu1.6) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up manpages-dev (5.05-1) ...
2022-08-01 20:39:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libfile-fcntllock-perl (0.22-3build4) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libalgorithm-diff-perl (1.19.03-2) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up binutils-common:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up linux-libc-dev:amd64 (5.4.0-122.138) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libctf-nobfd0:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libgomp1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-wheel (0.34.2-1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libfakeroot:amd64 (1.24-1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up fakeroot (1.24-1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up make (4.2.1-1.2) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libquadmath0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libmpc3:amd64 (1.1.0-1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libatomic1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libdpkg-perl (1.19.7ubuntu3.2) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libubsan1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libcrypt-dev:amd64 (1:4.4.10-10ubuntu4) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libisl22:amd64 (0.22.1-1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python-pip-whl (20.0.2-5ubuntu1.6) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libbinutils:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libc-dev-bin (2.31-0ubuntu9.9) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libalgorithm-diff-xs-perl (0.04-6) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libcc1-0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up liblsan0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libitm1:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up gcc-9-base:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libalgorithm-merge-perl (0.08-3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libtsan0:amd64 (10.3.0-1ubuntu1~20.04) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libctf0:amd64 (2.34-6ubuntu1.3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libasan5:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-pip (20.0.2-5ubuntu1.6) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up cpp-9 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libc6-dev:amd64 (2.31-0ubuntu9.9) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up binutils-x86-64-linux-gnu (2.34-6ubuntu1.3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up binutils (2.34-6ubuntu1.3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up dpkg-dev (1.19.7ubuntu3.2) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libgcc-9-dev:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libexpat1-dev:amd64 (2.2.9-1ubuntu0.4) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04.5) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu1.3) ...
2022-08-01 20:39:42 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up cpp (4:9.3.0-1ubuntu2) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up gcc-9 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libpython3-dev:amd64 (3.8.2-0ubuntu2) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libstdc++-9-dev:amd64 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up gcc (4:9.3.0-1ubuntu2) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up g++-9 (9.4.0-1ubuntu1~20.04.1) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3.8-dev (3.8.10-0ubuntu1~20.04.5) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up g++ (4:9.3.0-1ubuntu2) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up build-essential (12.8ubuntu1.1) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-dev (3.8.2-0ubuntu2) ...
2022-08-01 20:39:43 DEBUG unit.ceph-fs/0.install logger.go:60 Processing triggers for man-db (2.9.1-1) ...
2022-08-01 20:39:56 DEBUG unit.ceph-fs/0.install logger.go:60 Processing triggers for libc-bin (2.31-0ubuntu9.9) ...
2022-08-01 20:39:57 DEBUG unit.ceph-fs/0.install logger.go:60 Reading package lists...
2022-08-01 20:39:58 DEBUG unit.ceph-fs/0.install logger.go:60 Building dependency tree...
2022-08-01 20:39:58 DEBUG unit.ceph-fs/0.install logger.go:60 Reading state information...
2022-08-01 20:39:58 DEBUG unit.ceph-fs/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
2022-08-01 20:39:58 DEBUG unit.ceph-fs/0.install logger.go:60 Reading package lists...
2022-08-01 20:39:58 DEBUG unit.ceph-fs/0.install logger.go:60 Building dependency tree...
2022-08-01 20:39:58 DEBUG unit.ceph-fs/0.install logger.go:60 Reading state information...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 The following additional packages will be installed:
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60   python3-appdirs python3-distlib python3-filelock python3-virtualenv
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 The following NEW packages will be installed:
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60   python3-appdirs python3-distlib python3-filelock python3-virtualenv
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60   virtualenv
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 0 upgraded, 5 newly installed, 0 to remove and 0 not upgraded.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Need to get 199 kB of archives.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 After this operation, 1056 kB of additional disk space will be used.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Get:1 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 python3-appdirs all 1.4.3-2.1 [10.8 kB]
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Get:2 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/universe amd64 python3-distlib all 0.3.0-1 [116 kB]
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Get:3 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/universe amd64 python3-filelock all 3.0.12-2 [7948 B]
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Get:4 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-virtualenv all 20.0.17-1ubuntu0.4 [62.7 kB]
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Get:5 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/universe amd64 virtualenv all 20.0.17-1ubuntu0.4 [2144 B]
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Fetched 199 kB in 0s (6868 kB/s)
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-appdirs.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 (Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 67898 files and directories currently installed.)
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../python3-appdirs_1.4.3-2.1_all.deb ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-appdirs (1.4.3-2.1) ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-distlib.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../python3-distlib_0.3.0-1_all.deb ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-distlib (0.3.0-1) ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-filelock.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../python3-filelock_3.0.12-2_all.deb ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-filelock (3.0.12-2) ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-virtualenv.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../python3-virtualenv_20.0.17-1ubuntu0.4_all.deb ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-virtualenv (20.0.17-1ubuntu0.4) ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package virtualenv.
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../virtualenv_20.0.17-1ubuntu0.4_all.deb ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking virtualenv (20.0.17-1ubuntu0.4) ...
2022-08-01 20:39:59 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-filelock (3.0.12-2) ...
2022-08-01 20:40:00 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-distlib (0.3.0-1) ...
2022-08-01 20:40:00 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-appdirs (1.4.3-2.1) ...
2022-08-01 20:40:00 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-virtualenv (20.0.17-1ubuntu0.4) ...
2022-08-01 20:40:00 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up virtualenv (20.0.17-1ubuntu0.4) ...
2022-08-01 20:40:00 DEBUG unit.ceph-fs/0.install logger.go:60 Processing triggers for man-db (2.9.1-1) ...
2022-08-01 20:40:03 DEBUG unit.ceph-fs/0.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 264ms
2022-08-01 20:40:03 DEBUG unit.ceph-fs/0.install logger.go:60   creator CPython3Posix(dest=/var/lib/juju/agents/unit-ceph-fs-0/.venv, clear=False, global=False)
2022-08-01 20:40:03 DEBUG unit.ceph-fs/0.install logger.go:60   seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1)
2022-08-01 20:40:03 DEBUG unit.ceph-fs/0.install logger.go:60   activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator
2022-08-01 20:40:05 DEBUG unit.ceph-fs/0.install logger.go:60 Looking in links: wheelhouse
2022-08-01 20:40:05 DEBUG unit.ceph-fs/0.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages (20.0.2)
2022-08-01 20:40:06 DEBUG unit.ceph-fs/0.install logger.go:60 Looking in links: wheelhouse
2022-08-01 20:40:06 DEBUG unit.ceph-fs/0.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages (44.0.0)
2022-08-01 20:40:07 DEBUG unit.ceph-fs/0.install logger.go:60 Looking in links: wheelhouse
2022-08-01 20:40:07 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz
2022-08-01 20:40:07 DEBUG unit.ceph-fs/0.install logger.go:60 Building wheels for collected packages: setuptools-scm
2022-08-01 20:40:07 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for setuptools-scm (setup.py): started
2022-08-01 20:40:08 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for setuptools-scm (setup.py): finished with status 'done'
2022-08-01 20:40:08 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=0dbe22ea23d742acecd8cec3b93bba5bd858225cd9ce16fe0e3211cf9e9257fb
2022-08-01 20:40:08 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /root/.cache/pip/wheels/71/63/ec/7b809a7ccf141cc3871a34e40c8ef019f5348ac991442b110c
2022-08-01 20:40:08 DEBUG unit.ceph-fs/0.install logger.go:60 Successfully built setuptools-scm
2022-08-01 20:40:08 DEBUG unit.ceph-fs/0.install logger.go:60 Installing collected packages: setuptools-scm
2022-08-01 20:40:08 DEBUG unit.ceph-fs/0.install logger.go:60 Successfully installed setuptools-scm-1.17.0
2022-08-01 20:40:09 DEBUG unit.ceph-fs/0.install logger.go:60 Looking in links: wheelhouse
2022-08-01 20:40:09 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/netifaces-0.11.0.tar.gz
2022-08-01 20:40:09 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz
2022-08-01 20:40:09 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-1.1.1.tar.gz
2022-08-01 20:40:09 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/psutil-5.8.0.tar.gz
2022-08-01 20:40:10 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.4.1.tar.gz
2022-08-01 20:40:10 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/PyYAML-5.2.tar.gz
2022-08-01 20:40:10 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/ceph_api-0.4.0.tar.gz
2022-08-01 20:40:10 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/charms.openstack-0.0.1.dev1.zip
2022-08-01 20:40:11 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/Tempita-0.4.tar.gz
2022-08-01 20:40:11 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/dnspython-1.15.0.zip
2022-08-01 20:40:11 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/charms.ceph-0.0.1.dev1.zip
2022-08-01 20:40:11 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/pyaml-21.10.1.tar.gz
2022-08-01 20:40:11 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz
2022-08-01 20:40:12 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz
2022-08-01 20:40:12 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/Jinja2-2.10.1.tar.gz
2022-08-01 20:40:12 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/charmhelpers-0.20.23.zip
2022-08-01 20:40:14 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/pyxattr-0.7.2.tar.gz
2022-08-01 20:40:15 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/pbr-5.6.0.tar.gz
2022-08-01 20:40:15 DEBUG unit.ceph-fs/0.install logger.go:60 Processing ./wheelhouse/dnspython3-1.15.0.zip
2022-08-01 20:40:15 DEBUG unit.ceph-fs/0.install logger.go:60 Building wheels for collected packages: netifaces, wheel, MarkupSafe, psutil, charms.reactive, PyYAML, ceph-api, charms.openstack, Tempita, dnspython, charms.ceph, pyaml, six, netaddr, Jinja2, charmhelpers, pyxattr, pbr, dnspython3
2022-08-01 20:40:15 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for netifaces (setup.py): started
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for netifaces (setup.py): finished with status 'done'
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for netifaces: filename=netifaces-0.11.0-cp38-cp38-linux_x86_64.whl size=41827 sha256=495e10e5432cffd5b5e3d454601a143ff2ff33c07df3133d3b2d0b859a9aa4ec
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/ab/73/37/512cebfb9448b646e64a17b395b5fd2b7c075b7a53bc1d6aa6
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for wheel (setup.py): started
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for wheel (setup.py): finished with status 'done'
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=c5320a13d2e79a511f382ca1e920d890399a6ffc29ff2356e4d51a250f3ef32c
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/ab/fc/4f/6e125cb524f18c3d4fcbfbb61e59b13d5aaf654f31203bd933
2022-08-01 20:40:17 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for MarkupSafe (setup.py): started
2022-08-01 20:40:18 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for MarkupSafe (setup.py): finished with status 'done'
2022-08-01 20:40:18 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for MarkupSafe: filename=MarkupSafe-1.1.1-cp38-cp38-linux_x86_64.whl size=32943 sha256=d6a712df26c22e866eb3d651fabb23cce4b26e2d484bec1fd03294e063057d6e
2022-08-01 20:40:18 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/67/34/e0/e53323cebb234bd9db521633ee82c3c33b2b958e9b75693c2c
2022-08-01 20:40:18 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for psutil (setup.py): started
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for psutil (setup.py): finished with status 'done'
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for psutil: filename=psutil-5.8.0-cp38-cp38-linux_x86_64.whl size=300993 sha256=1e311309780b2078455b1c94c264e43e677fa727725840ea95be557c6147c30b
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/f5/8e/04/9c881850dfbe7f57e3113ea6f47a542f1d7ae2de81535217a9
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charms.reactive (setup.py): started
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charms.reactive (setup.py): finished with status 'done'
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for charms.reactive: filename=charms.reactive-1.4.1-py3-none-any.whl size=43697 sha256=f7d4e01c2144218ced306529230bcf502294b68f2b7690eca11c56383a0f114a
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/30/08/d6/9aa549ce1b0ea9d75b5e7c3f5b4458101254c3e10cda4d43ad
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for PyYAML (setup.py): started
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for PyYAML (setup.py): finished with status 'done'
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for PyYAML: filename=PyYAML-5.2-cp38-cp38-linux_x86_64.whl size=44208 sha256=29aa5be9f0a8fdb5a8741ea0017750b374eeca4d49b4c13d813bf59b47ed83ed
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/28/ec/fe/850de9caaf38395bc87f31bab868b75903c76567c44faf4c48
2022-08-01 20:40:19 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for ceph-api (setup.py): started
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for ceph-api (setup.py): finished with status 'done'
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for ceph-api: filename=ceph_api-0.4.0-py2.py3-none-any.whl size=70488 sha256=b80ad8511d629a98b7f342dc0db582a82ade9de78eef047d4e4e7a4dbcc06d9a
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/48/fb/cc/71cba4f3409739cd91d48733fb739ae6228faa4c639c1e7fd7
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charms.openstack (setup.py): started
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charms.openstack (setup.py): finished with status 'done'
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for charms.openstack: filename=charms.openstack-0.0.1.dev1-py3-none-any.whl size=106439 sha256=72717cface71732a5fde5839a2b71cbc1dc9041b737b6ec70c57d91780683681
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/83/9f/7e/fb5bf820fa4d2d2458591729d3154f484692dec5603bad6301
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for Tempita (setup.py): started
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for Tempita (setup.py): finished with status 'done'
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for Tempita: filename=Tempita-0.4-py3-none-any.whl size=11793 sha256=b261945ee4399944c158c98f04e988eb34311e232d1c7470fbda0c6137f623db
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/30/f7/8e/8a3d2d093bd865ea4431e8a3d2886c4761367bee3c0578f390
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for dnspython (setup.py): started
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for dnspython (setup.py): finished with status 'done'
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for dnspython: filename=dnspython-1.15.0-py3-none-any.whl size=176206 sha256=0bfb2e783d16eb0a4dede33cd9a61fbff4120fb4c3c1102a425373a41299bbed
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/e6/90/9a/d0e0547386b1625d8ec10d312835591d6f17ab31b569f12597
2022-08-01 20:40:20 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charms.ceph (setup.py): started
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charms.ceph (setup.py): finished with status 'done'
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for charms.ceph: filename=charms.ceph-0.0.1.dev1-py3-none-any.whl size=40353 sha256=47791b8d68a32f0b7b0186ec439459fb76c2a15d93de0aed671b92215c19b3f7
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/1b/79/fe/cfe6f3832a8b8597032df194ac66d8808c47f9368f9f18d04a
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for pyaml (setup.py): started
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for pyaml (setup.py): finished with status 'done'
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for pyaml: filename=pyaml-21.10.1-py2.py3-none-any.whl size=17625 sha256=3cfefb704fa45e31621da4c5481f386ed7f21cf842b6485dcd88369a0e3950fd
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/85/2b/1e/293682a4eeb69a49d4175b067d05dbf9fd05c9acd47570c23d
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for six (setup.py): started
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for six (setup.py): finished with status 'done'
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11053 sha256=16b3cdfcf793be19b24ed848b9f60cb35a2f34bab92ae0518bf3fe898d62e124
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/49/cc/2e/d62afd75ceccb7cdd7e2487e6ad46d51b0682274d8ec5a3e55
2022-08-01 20:40:21 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for netaddr (setup.py): started
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for netaddr (setup.py): finished with status 'done'
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=076d15745765837dc8c30b2a2d7ed1510d8e53000195edd9eb9a9bd511575e83
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/0e/fa/ee/d546bd3a64e7d538108b904aa65f09c3c4ebe914ad5be2a9e5
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for Jinja2 (setup.py): started
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for Jinja2 (setup.py): finished with status 'done'
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for Jinja2: filename=Jinja2-2.10.1-py2.py3-none-any.whl size=124884 sha256=ce7a76cc379c27f42807be8e09073016096cea873f31a6839672e225e4ccba4d
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/90/87/5d/88ba389f94e73b45efabd50d7ac1007ffecb9b7b2bc2c60861
2022-08-01 20:40:22 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charmhelpers (setup.py): started
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for charmhelpers (setup.py): finished with status 'done'
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for charmhelpers: filename=charmhelpers-0.20.23-py3-none-any.whl size=406690 sha256=cd3d6e6896c0e2d2e44a54548cd21e2d8293d59e00b23eef44ab5c163107d869
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/88/f6/a9/b3d9c68b87807fc4b7a810ea9bea204c4e9e718ea7e67ee2ef
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for pyxattr (setup.py): started
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for pyxattr (setup.py): finished with status 'done'
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for pyxattr: filename=pyxattr-0.7.2-cp38-cp38-linux_x86_64.whl size=44360 sha256=71d746dc2f758d8d664b53f1f453b3709758f815bac0d0ee8da4bdb27bd1ebcb
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/b0/b4/d3/40833a0ff471af9f685e648152c7dd692873704ac7385495b4
2022-08-01 20:40:23 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for pbr (setup.py): started
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for pbr (setup.py): finished with status 'done'
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for pbr: filename=pbr-5.6.0-py2.py3-none-any.whl size=111309 sha256=2665b32302d69aca67bbd4c4b0d6ca760b48fe2ec05b4698d27a4bb6ea1e99ef
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/bd/4b/95/06189ce6056a06fa820c709e0e44d8b469331c2c1dd16f4e2e
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for dnspython3 (setup.py): started
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Building wheel for dnspython3 (setup.py): finished with status 'done'
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Created wheel for dnspython3: filename=dnspython3-1.15.0-py3-none-any.whl size=1759 sha256=d506bf32d9f3183c426d869610d0ac5c6b4c0b09f76dfce7fa779b1b5eea0836
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Stored in directory: /tmp/pip-ephem-wheel-cache-t24o43ot/wheels/fa/c5/00/ca593ecc4326757aea9561b497a68b89dd90bf2ad72e36a7e3
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60 Successfully built netifaces wheel MarkupSafe psutil charms.reactive PyYAML ceph-api charms.openstack Tempita dnspython charms.ceph pyaml six netaddr Jinja2 charmhelpers pyxattr pbr dnspython3
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60 Installing collected packages: netifaces, wheel, MarkupSafe, psutil, Jinja2, PyYAML, Tempita, netaddr, pbr, six, charmhelpers, pyaml, charms.reactive, ceph-api, charms.openstack, dnspython, charms.ceph, pyxattr, dnspython3
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60   Attempting uninstall: wheel
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60     Found existing installation: wheel 0.34.2
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60     Uninstalling wheel-0.34.2:
2022-08-01 20:40:24 DEBUG unit.ceph-fs/0.install logger.go:60       Successfully uninstalled wheel-0.34.2
2022-08-01 20:40:25 DEBUG unit.ceph-fs/0.install logger.go:60 Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 PyYAML-5.2 Tempita-0.4 ceph-api-0.4.0 charmhelpers-0.20.23 charms.ceph-0.0.1.dev1 charms.openstack-0.0.1.dev1 charms.reactive-1.4.1 dnspython-1.15.0 dnspython3-1.15.0 netaddr-0.7.19 netifaces-0.11.0 pbr-5.6.0 psutil-5.8.0 pyaml-21.10.1 pyxattr-0.7.2 six-1.16.0 wheel-0.33.6
2022-08-01 20:40:25 INFO unit.ceph-fs/0.juju-log server.go:319 Reactive main running for hook install
2022-08-01 20:40:25 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: starting handler dispatch, 79 flags set
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.changed
tracer: set flag config.changed.bluestore-compression-algorithm
tracer: set flag config.changed.bluestore-compression-max-blob-size
tracer: set flag config.changed.bluestore-compression-max-blob-size-hdd
tracer: set flag config.changed.bluestore-compression-max-blob-size-ssd
tracer: set flag config.changed.bluestore-compression-min-blob-size
tracer: set flag config.changed.bluestore-compression-min-blob-size-hdd
tracer: set flag config.changed.bluestore-compression-min-blob-size-ssd
tracer: set flag config.changed.bluestore-compression-mode
tracer: set flag config.changed.bluestore-compression-required-ratio
tracer: set flag config.changed.ceph-osd-replication-count
tracer: set flag config.changed.ceph-pool-weight
tracer: set flag config.changed.ceph-public-network
tracer: set flag config.changed.ec-pool-weight
tracer: set flag config.changed.ec-profile-crush-locality
tracer: set flag config.changed.ec-profile-device-class
tracer: set flag config.changed.ec-profile-durability-estimator
tracer: set flag config.changed.ec-profile-helper-chunks
tracer: set flag config.changed.ec-profile-k
tracer: set flag config.changed.ec-profile-locality
tracer: set flag config.changed.ec-profile-m
tracer: set flag config.changed.ec-profile-name
tracer: set flag config.changed.ec-profile-plugin
tracer: set flag config.changed.ec-profile-scalar-mds
tracer: set flag config.changed.ec-profile-technique
tracer: set flag config.changed.key
tracer: set flag config.changed.loglevel
tracer: set flag config.changed.metadata-pool
tracer: set flag config.changed.pool-type
tracer: set flag config.changed.prefer-ipv6
tracer: set flag config.changed.rbd-pool-name
tracer: set flag config.changed.source
tracer: set flag config.changed.use-syslog
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
2022-08-01 20:40:25 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:25 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: main dispatch loop, 4 handlers queued
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
tracer: ++   queue handler reactive/layer_openstack.py:15:default_install
tracer: ++   queue handler reactive/layer_openstack.py:34:default_config_changed
2022-08-01 20:40:25 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:15:default_install
2022-08-01 20:40:26 WARNING unit.ceph-fs/0.juju-log server.go:319 Package openstack-release has no installation candidate.
2022-08-01 20:40:28 WARNING unit.ceph-fs/0.juju-log server.go:319 Package horizon-common has no installation candidate.
2022-08-01 20:40:29 WARNING unit.ceph-fs/0.juju-log server.go:319 Package openstack-release has no installation candidate.
2022-08-01 20:40:30 DEBUG unit.ceph-fs/0.install logger.go:60 Hit:1 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal InRelease
2022-08-01 20:40:30 DEBUG unit.ceph-fs/0.install logger.go:60 Hit:2 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates InRelease
2022-08-01 20:40:30 DEBUG unit.ceph-fs/0.install logger.go:60 Hit:3 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-backports InRelease
2022-08-01 20:40:30 DEBUG unit.ceph-fs/0.install logger.go:60 Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease
2022-08-01 20:40:31 DEBUG unit.ceph-fs/0.install logger.go:60 Reading package lists...
2022-08-01 20:40:33 INFO unit.ceph-fs/0.juju-log server.go:319 Installing ['ceph-mds'] with options: ['--option=Dpkg::Options::=--force-confold']
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Reading package lists...
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Building dependency tree...
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Reading state information...
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 The following additional packages will be installed:
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   ceph-base ceph-common ibverbs-providers libbabeltrace1
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libboost-context1.71.0 libboost-iostreams1.71.0
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libboost-program-options1.71.0 libboost-thread1.71.0 libcephfs2 libdw1
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libgoogle-perftools4 libibverbs1 libleveldb1d libnl-3-200 libnl-route-3-200
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   liboath0 librabbitmq4 librados2 libradosstriper1 librbd1 librdmacm1
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libsnappy1v5 libtcmalloc-minimal4 python3-ceph-argparse python3-ceph-common
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   python3-cephfs python3-prettytable python3-rados python3-rbd
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Suggested packages:
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   btrfs-tools ceph ceph-fuse
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 The following NEW packages will be installed:
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   ceph-base ceph-common ceph-mds ibverbs-providers libbabeltrace1
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libboost-context1.71.0 libboost-iostreams1.71.0
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libboost-program-options1.71.0 libboost-thread1.71.0 libcephfs2 libdw1
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libgoogle-perftools4 libibverbs1 libleveldb1d libnl-3-200 libnl-route-3-200
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   liboath0 librabbitmq4 librados2 libradosstriper1 librbd1 librdmacm1
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   libsnappy1v5 libtcmalloc-minimal4 python3-ceph-argparse python3-ceph-common
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60   python3-cephfs python3-prettytable python3-rados python3-rbd
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 0 upgraded, 30 newly installed, 0 to remove and 0 not upgraded.
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Need to get 33.7 MB of archives.
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 After this operation, 141 MB of additional disk space will be used.
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:1 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libboost-iostreams1.71.0 amd64 1.71.0-6ubuntu6 [237 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:2 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libboost-thread1.71.0 amd64 1.71.0-6ubuntu6 [249 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:3 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libnl-3-200 amd64 3.4.0-1 [53.9 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:4 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libnl-route-3-200 amd64 3.4.0-1 [149 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:5 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libibverbs1 amd64 28.0-1ubuntu1 [53.6 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:6 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 librdmacm1 amd64 28.0-1ubuntu1 [64.9 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:7 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.16-0ubuntu0.20.04.1 [3214 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:8 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.16-0ubuntu0.20.04.1 [1623 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:9 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-ceph-argparse amd64 15.2.16-0ubuntu0.20.04.1 [31.4 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:10 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-ceph-common all 15.2.16-0ubuntu0.20.04.1 [40.0 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:11 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libcephfs2 amd64 15.2.16-0ubuntu0.20.04.1 [470 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:12 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-rados amd64 15.2.16-0ubuntu0.20.04.1 [374 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:13 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cephfs amd64 15.2.16-0ubuntu0.20.04.1 [165 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:14 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:15 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-rbd amd64 15.2.16-0ubuntu0.20.04.1 [372 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:16 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libdw1 amd64 0.176-1.1build1 [226 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:17 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libbabeltrace1 amd64 1.5.8-1build1 [156 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:18 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libboost-context1.71.0 amd64 1.71.0-6ubuntu6 [207 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:19 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libboost-program-options1.71.0 amd64 1.71.0-6ubuntu6 [342 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:20 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libtcmalloc-minimal4 amd64 2.7-1ubuntu2 [93.0 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:21 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libgoogle-perftools4 amd64 2.7-1ubuntu2 [195 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:22 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libsnappy1v5 amd64 1.1.8-1build1 [16.7 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:23 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:24 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:25 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:26 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 libradosstriper1 amd64 15.2.16-0ubuntu0.20.04.1 [378 kB]
2022-08-01 20:40:33 DEBUG unit.ceph-fs/0.install logger.go:60 Get:27 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 ceph-common amd64 15.2.16-0ubuntu0.20.04.1 [18.4 MB]
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Get:28 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 ceph-base amd64 15.2.16-0ubuntu0.20.04.1 [4171 kB]
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Get:29 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 ceph-mds amd64 15.2.16-0ubuntu0.20.04.1 [1986 kB]
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Get:30 http://us-east-2.ec2.archive.ubuntu.com/ubuntu focal/main amd64 ibverbs-providers amd64 28.0-1ubuntu1 [232 kB]
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Fetched 33.7 MB in 1s (66.1 MB/s)
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libboost-iostreams1.71.0:amd64.
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 (Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 68090 files and directories currently installed.)
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../00-libboost-iostreams1.71.0_1.71.0-6ubuntu6_amd64.deb ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libboost-iostreams1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libboost-thread1.71.0:amd64.
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../01-libboost-thread1.71.0_1.71.0-6ubuntu6_amd64.deb ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libboost-thread1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libnl-3-200:amd64.
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../02-libnl-3-200_3.4.0-1_amd64.deb ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libnl-3-200:amd64 (3.4.0-1) ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libnl-route-3-200:amd64.
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../03-libnl-route-3-200_3.4.0-1_amd64.deb ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libnl-route-3-200:amd64 (3.4.0-1) ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libibverbs1:amd64.
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../04-libibverbs1_28.0-1ubuntu1_amd64.deb ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libibverbs1:amd64 (28.0-1ubuntu1) ...
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package librdmacm1:amd64.
2022-08-01 20:40:34 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../05-librdmacm1_28.0-1ubuntu1_amd64.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking librdmacm1:amd64 (28.0-1ubuntu1) ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package librados2.
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../06-librados2_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking librados2 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package librbd1.
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../07-librbd1_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking librbd1 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-ceph-argparse.
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../08-python3-ceph-argparse_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-ceph-argparse (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-ceph-common.
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../09-python3-ceph-common_15.2.16-0ubuntu0.20.04.1_all.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-ceph-common (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libcephfs2.
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../10-libcephfs2_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libcephfs2 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-rados.
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../11-python3-rados_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-rados (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-cephfs.
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../12-python3-cephfs_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:35 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-cephfs (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-prettytable.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../13-python3-prettytable_0.7.2-5_all.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-prettytable (0.7.2-5) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package python3-rbd.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../14-python3-rbd_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking python3-rbd (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libdw1:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../15-libdw1_0.176-1.1build1_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libdw1:amd64 (0.176-1.1build1) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libbabeltrace1:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../16-libbabeltrace1_1.5.8-1build1_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libbabeltrace1:amd64 (1.5.8-1build1) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libboost-context1.71.0:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../17-libboost-context1.71.0_1.71.0-6ubuntu6_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libboost-context1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libboost-program-options1.71.0:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../18-libboost-program-options1.71.0_1.71.0-6ubuntu6_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libboost-program-options1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libtcmalloc-minimal4:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../19-libtcmalloc-minimal4_2.7-1ubuntu2_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libtcmalloc-minimal4:amd64 (2.7-1ubuntu2) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libgoogle-perftools4:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../20-libgoogle-perftools4_2.7-1ubuntu2_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libgoogle-perftools4:amd64 (2.7-1ubuntu2) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libsnappy1v5:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../21-libsnappy1v5_1.1.8-1build1_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libsnappy1v5:amd64 (1.1.8-1build1) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libleveldb1d:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../22-libleveldb1d_1.22-3ubuntu2_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package liboath0.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../23-liboath0_2.6.1-1.3_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking liboath0 (2.6.1-1.3) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package librabbitmq4:amd64.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../24-librabbitmq4_0.10.0-1_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking librabbitmq4:amd64 (0.10.0-1) ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package libradosstriper1.
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../25-libradosstriper1_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:36 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking libradosstriper1 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:37 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package ceph-common.
2022-08-01 20:40:37 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../26-ceph-common_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:37 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking ceph-common (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:39 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package ceph-base.
2022-08-01 20:40:39 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../27-ceph-base_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:39 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking ceph-base (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package ceph-mds.
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../28-ceph-mds_15.2.16-0ubuntu0.20.04.1_amd64.deb ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking ceph-mds (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Selecting previously unselected package ibverbs-providers:amd64.
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Preparing to unpack .../29-ibverbs-providers_28.0-1ubuntu1_amd64.deb ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Unpacking ibverbs-providers:amd64 (28.0-1ubuntu1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libdw1:amd64 (0.176-1.1build1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up librabbitmq4:amd64 (0.10.0-1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up liboath0 (2.6.1-1.3) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libtcmalloc-minimal4:amd64 (2.7-1ubuntu2) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-ceph-argparse (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libboost-iostreams1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libsnappy1v5:amd64 (1.1.8-1build1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-ceph-common (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:40 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libbabeltrace1:amd64 (1.5.8-1build1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libnl-3-200:amd64 (3.4.0-1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libboost-thread1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libboost-context1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-prettytable (0.7.2-5) ...
2022-08-01 20:40:41 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[ceph-mon/2:{0}] map[] []}}
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libgoogle-perftools4:amd64 (2.7-1ubuntu2) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libboost-program-options1.71.0:amd64 (1.71.0-6ubuntu6) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libnl-route-3-200:amd64 (3.4.0-1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libibverbs1:amd64 (28.0-1ubuntu1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up ibverbs-providers:amd64 (28.0-1ubuntu1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up librdmacm1:amd64 (28.0-1ubuntu1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up librados2 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libcephfs2 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up libradosstriper1 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up librbd1 (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-rados (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-rbd (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up python3-cephfs (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up ceph-common (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Adding group ceph....done
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Adding system user ceph....done
2022-08-01 20:40:41 DEBUG unit.ceph-fs/0.install logger.go:60 Setting system user ceph properties....done
2022-08-01 20:40:42 DEBUG unit.ceph-fs/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target.
2022-08-01 20:40:42 DEBUG unit.ceph-fs/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service.
2022-08-01 20:40:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up ceph-base (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:43 DEBUG unit.ceph-fs/0.install logger.go:60 Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service.
2022-08-01 20:40:43 DEBUG unit.ceph-fs/0.install logger.go:60 Setting up ceph-mds (15.2.16-0ubuntu0.20.04.1) ...
2022-08-01 20:40:43 DEBUG unit.ceph-fs/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target.
2022-08-01 20:40:43 DEBUG unit.ceph-fs/0.install logger.go:60 Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target.
2022-08-01 20:40:44 DEBUG unit.ceph-fs/0.install logger.go:60 Processing triggers for libc-bin (2.31-0ubuntu9.9) ...
2022-08-01 20:40:44 DEBUG unit.ceph-fs/0.install logger.go:60 Processing triggers for systemd (245.4-4ubuntu3.17) ...
2022-08-01 20:40:44 DEBUG unit.ceph-fs/0.install logger.go:60 Processing triggers for man-db (2.9.1-1) ...
2022-08-01 20:40:46 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer: set flag ceph-fs-installed
2022-08-01 20:40:46 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: set flag charm.installed
tracer: -- dequeue handler reactive/layer_openstack.py:15:default_install
2022-08-01 20:40:46 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:34:default_config_changed
2022-08-01 20:40:46 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:46 DEBUG unit.ceph-fs/0.install logger.go:60 inactive
2022-08-01 20:40:46 WARNING unit.ceph-fs/0.install logger.go:60 Created symlink /etc/systemd/system/ceph-mds@ip-172-31-8-250.service → /dev/null.
2022-08-01 20:40:47 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:40:47 DEBUG unit.ceph-fs/0.juju-log server.go:319 Running _assess_status()
2022-08-01 20:40:47 INFO juju.worker.uniter.operation runhook.go:146 ran "install" hook (via explicit, bespoke hook script)
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run install hook)
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "ceph-fs/0" (leader=true) entered scope for relation "ceph-fs:ceph-mds ceph-mon:mds"
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (30; app: ceph-mon) hook for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-created (30; app: ceph-mon) hook)
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-created (30; app: ceph-mon) hook)
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (30; app: ceph-mon) hook" for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (30; app: ceph-mon) hook" for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-created hook
2022-08-01 20:40:47 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:47 INFO juju.worker.uniter.operation runhook.go:149 skipped "ceph-mds-relation-created" hook (missing)
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (30; app: ceph-mon) hook" for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-created (30; app: ceph-mon) hook)
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for ceph-fs/0
2022-08-01 20:40:47 INFO juju.worker.uniter resolver.go:148 found queued "leader-elected" hook
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for ceph-fs/0
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run leader-elected hook)
2022-08-01 20:40:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run leader-elected hook)
2022-08-01 20:40:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for ceph-fs/0
2022-08-01 20:40:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for ceph-fs/0
2022-08-01 20:40:48 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running leader-elected hook
2022-08-01 20:40:48 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:48 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[ceph-mon/1:{0}] map[] []}}
2022-08-01 20:40:48 INFO unit.ceph-fs/0.juju-log server.go:319 Reactive main running for hook leader-elected
2022-08-01 20:40:48 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: starting handler dispatch, 48 flags set
tracer: set flag ceph-fs-installed
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
2022-08-01 20:40:48 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:48 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: main dispatch loop, 2 handlers queued
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:48 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:48 DEBUG unit.ceph-fs/0.leader-elected logger.go:60 inactive
2022-08-01 20:40:48 WARNING unit.ceph-fs/0.leader-elected logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:40:48 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:40:49 DEBUG unit.ceph-fs/0.juju-log server.go:319 Running _assess_status()
2022-08-01 20:40:49 INFO juju.worker.uniter.operation runhook.go:146 ran "leader-elected" hook (via explicit, bespoke hook script)
2022-08-01 20:40:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for ceph-fs/0
2022-08-01 20:40:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run leader-elected hook)
2022-08-01 20:40:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:49 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:40:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for ceph-fs/0
2022-08-01 20:40:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run config-changed hook)
2022-08-01 20:40:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run config-changed hook)
2022-08-01 20:40:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for ceph-fs/0
2022-08-01 20:40:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for ceph-fs/0
2022-08-01 20:40:49 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running config-changed hook
2022-08-01 20:40:49 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:49 INFO unit.ceph-fs/0.juju-log server.go:319 Reactive main running for hook config-changed
2022-08-01 20:40:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: starting handler dispatch, 48 flags set
tracer: set flag ceph-fs-installed
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
2022-08-01 20:40:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: main dispatch loop, 2 handlers queued
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:50 DEBUG unit.ceph-fs/0.config-changed logger.go:60 inactive
2022-08-01 20:40:50 WARNING unit.ceph-fs/0.config-changed logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:40:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:40:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 Running _assess_status()
2022-08-01 20:40:51 INFO juju.worker.uniter.operation runhook.go:146 ran "config-changed" hook (via explicit, bespoke hook script)
2022-08-01 20:40:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for ceph-fs/0
2022-08-01 20:40:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run config-changed hook)
2022-08-01 20:40:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:51 INFO juju.worker.uniter resolver.go:148 found queued "start" hook
2022-08-01 20:40:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for ceph-fs/0
2022-08-01 20:40:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run start hook)
2022-08-01 20:40:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run start hook)
2022-08-01 20:40:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for ceph-fs/0
2022-08-01 20:40:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for ceph-fs/0
2022-08-01 20:40:51 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running start hook
2022-08-01 20:40:51 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:52 INFO unit.ceph-fs/0.juju-log server.go:319 Reactive main running for hook start
2022-08-01 20:40:52 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: starting handler dispatch, 48 flags set
tracer: set flag ceph-fs-installed
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
2022-08-01 20:40:52 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:52 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: main dispatch loop, 2 handlers queued
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:52 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:52 DEBUG unit.ceph-fs/0.start logger.go:60 inactive
2022-08-01 20:40:52 WARNING unit.ceph-fs/0.start logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:40:52 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:40:52 DEBUG unit.ceph-fs/0.juju-log server.go:319 Running _assess_status()
2022-08-01 20:40:53 INFO juju.worker.uniter.operation runhook.go:146 ran "start" hook (via explicit, bespoke hook script)
2022-08-01 20:40:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for ceph-fs/0
2022-08-01 20:40:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run start hook)
2022-08-01 20:40:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:53 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:40:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (30; unit: ceph-mon/1) hook for ceph-fs/0
2022-08-01 20:40:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/1) hook)
2022-08-01 20:40:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/1) hook)
2022-08-01 20:40:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:40:53 DEBUG juju.worker.dependency engine.go:578 "metric-collect" manifold worker started at 2022-08-01 20:40:53.643931218 +0000 UTC
2022-08-01 20:40:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:40:53 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-joined hook for ceph-mon/1
2022-08-01 20:40:53 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:53 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-joined
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag endpoint.ceph-mds.joined
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag endpoint.ceph-mds.changed
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag endpoint.ceph-mds.changed.egress-subnets
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag endpoint.ceph-mds.changed.ingress-address
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag endpoint.ceph-mds.changed.private-address
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 53 flags set
tracer: set flag ceph-fs-installed
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 4 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:54 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.ceph-mds-relation-joined logger.go:60 inactive
2022-08-01 20:40:54 WARNING unit.ceph-fs/0.ceph-mds-relation-joined logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:40:54 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:40:54 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag ceph-mds.connected
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:40:54 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:40:54 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:40:54 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:40:55 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-joined" hook (via explicit, bespoke hook script)
2022-08-01 20:40:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:40:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/1) hook)
2022-08-01 20:40:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:55 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:40:55 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (30; unit: ceph-mon/1) hook for ceph-fs/0
2022-08-01 20:40:55 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/1) hook)
2022-08-01 20:40:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/1) hook)
2022-08-01 20:40:55 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:40:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:40:55 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-changed hook for ceph-mon/1
2022-08-01 20:40:55 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:55 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-changed
2022-08-01 20:40:56 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 54 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:40:56 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:56 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:56 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:40:56 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:40:56 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: incomplete request. broker_req not found
2022-08-01 20:40:56 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:40:57 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-changed" hook (via explicit, bespoke hook script)
2022-08-01 20:40:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:40:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/1) hook)
2022-08-01 20:40:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:57 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:40:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:40:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (30; unit: ceph-mon/2) hook for ceph-fs/0
2022-08-01 20:40:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/2) hook)
2022-08-01 20:40:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/2) hook)
2022-08-01 20:40:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:40:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:40:57 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-joined hook for ceph-mon/2
2022-08-01 20:40:57 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:57 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-joined
2022-08-01 20:40:57 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 54 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:40:57 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:57 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:57 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:57 DEBUG unit.ceph-fs/0.ceph-mds-relation-joined logger.go:60 inactive
2022-08-01 20:40:57 WARNING unit.ceph-fs/0.ceph-mds-relation-joined logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:40:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: incomplete request. broker_req not found
2022-08-01 20:40:58 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:40:59 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-joined" hook (via explicit, bespoke hook script)
2022-08-01 20:40:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:40:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:40:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/2) hook)
2022-08-01 20:40:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:40:59 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:40:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (30; unit: ceph-mon/2) hook for ceph-fs/0
2022-08-01 20:40:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/2) hook)
2022-08-01 20:40:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/2) hook)
2022-08-01 20:40:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:40:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:40:59 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-changed hook for ceph-mon/2
2022-08-01 20:40:59 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:40:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-changed
2022-08-01 20:40:59 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 54 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:40:59 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:40:59 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:40:59 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:40:59 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:41:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: incomplete request. broker_req not found
2022-08-01 20:41:00 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:41:01 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-changed" hook (via explicit, bespoke hook script)
2022-08-01 20:41:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:41:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:41:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/2) hook)
2022-08-01 20:41:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:41:01 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:41:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:41:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:41:01 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] idle: 
2022-08-01 20:41:01 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:41:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:41:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:41:12 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[ceph-mon/0:{0}] map[] []}}
2022-08-01 20:41:12 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:41:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (30; unit: ceph-mon/0) hook for ceph-fs/0
2022-08-01 20:41:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/0) hook)
2022-08-01 20:41:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/0) hook)
2022-08-01 20:41:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:41:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:41:12 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-joined hook for ceph-mon/0
2022-08-01 20:41:12 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:41:13 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-joined
2022-08-01 20:41:13 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 54 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:41:13 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:41:13 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:41:13 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:41:13 DEBUG unit.ceph-fs/0.ceph-mds-relation-joined logger.go:60 inactive
2022-08-01 20:41:13 WARNING unit.ceph-fs/0.ceph-mds-relation-joined logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:41:14 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: incomplete request. broker_req not found
2022-08-01 20:41:14 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:41:14 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-joined" hook (via explicit, bespoke hook script)
2022-08-01 20:41:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:41:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:41:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-joined (30; unit: ceph-mon/0) hook)
2022-08-01 20:41:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:41:14 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:41:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (30; unit: ceph-mon/0) hook for ceph-fs/0
2022-08-01 20:41:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/0) hook)
2022-08-01 20:41:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/0) hook)
2022-08-01 20:41:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:41:15 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:41:15 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-changed hook for ceph-mon/0
2022-08-01 20:41:15 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:41:15 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-changed
2022-08-01 20:41:15 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 54 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:41:15 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:41:15 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:41:15 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:41:15 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:41:15 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:41:16 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: incomplete request. broker_req not found
2022-08-01 20:41:16 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:41:16 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-changed" hook (via explicit, bespoke hook script)
2022-08-01 20:41:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:41:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:41:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/0) hook)
2022-08-01 20:41:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:41:16 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:41:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:41:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:41:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:41:16 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] idle: 
2022-08-01 20:42:21 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[ceph-mon/0:{1}] map[] []}}
2022-08-01 20:42:21 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:42:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:42:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:42:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:42:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (30; unit: ceph-mon/0) hook for ceph-fs/0
2022-08-01 20:42:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/0) hook)
2022-08-01 20:42:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/0) hook)
2022-08-01 20:42:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:42:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:42:21 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-changed hook for ceph-mon/0
2022-08-01 20:42:21 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:42:21 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-changed
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag endpoint.ceph-mds.changed.fsid
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 58 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:42:22 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag ceph-mds.available
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:42:22 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: incomplete request. broker_req not found
2022-08-01 20:42:22 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:42:23 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:42:23 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-changed" hook (via explicit, bespoke hook script)
2022-08-01 20:42:23 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (30; unit: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:42:23 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:42:23 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/0) hook)
2022-08-01 20:42:23 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:42:23 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:42:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:42:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:42:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:42:23 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] idle: 
2022-08-01 20:42:27 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[ceph-mon/1:{1}] map[] []}}
2022-08-01 20:42:27 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:42:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:42:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:42:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:42:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (30; unit: ceph-mon/1) hook for ceph-fs/0
2022-08-01 20:42:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/1) hook)
2022-08-01 20:42:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/1) hook)
2022-08-01 20:42:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:42:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:42:27 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-changed hook for ceph-mon/1
2022-08-01 20:42:27 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:42:28 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-changed
2022-08-01 20:42:28 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 59 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:42:28 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:42:28 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:28 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:28 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:42:28 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:42:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: incomplete request. broker_req not found
2022-08-01 20:42:29 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:42:29 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:42:29 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-changed" hook (via explicit, bespoke hook script)
2022-08-01 20:42:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (30; unit: ceph-mon/1) hook" for ceph-fs/0
2022-08-01 20:42:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:42:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/1) hook)
2022-08-01 20:42:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:42:29 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:42:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:42:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:42:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:42:29 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] idle: 
2022-08-01 20:42:58 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[ceph-mon/2:{1}] map[] []}}
2022-08-01 20:42:58 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:42:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:42:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:42:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:42:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (30; unit: ceph-mon/2) hook for ceph-fs/0
2022-08-01 20:42:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/2) hook)
2022-08-01 20:42:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/2) hook)
2022-08-01 20:42:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:42:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:42:58 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-changed hook for ceph-mon/2
2022-08-01 20:42:58 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:42:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-changed
2022-08-01 20:42:58 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:58 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 60 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:42:58 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:42:58 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 5 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:159:default_config_not_rendered
2022-08-01 20:42:58 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:42:58 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Unit /etc/systemd/system/ceph-mds@ip-172-31-8-250.service is masked, ignoring.
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Setting ceph-client.pools.available
2022-08-01 20:42:59 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag ceph-mds.pools.available
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Making dir /var/lib/ceph/mds/ceph-ip-172-31-8-250 ceph:ceph 750
2022-08-01 20:42:59 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 creating /var/lib/ceph/mds/ceph-ip-172-31-8-250/keyring
2022-08-01 20:42:59 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 added entity mds.ip-172-31-8-250 auth(key=AQCrOuhiikuwNxAA0lhxx+kkCUmnMuxxoGt1Ow==)
2022-08-01 20:42:59 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Writing file /etc/ceph/ceph.conf root:ceph 640
2022-08-01 20:42:59 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Failed to start ceph-mds@ip-172-31-8-250.service: Unit ceph-mds@ip-172-31-8-250.service is masked.
2022-08-01 20:42:59 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag cephfs.configured
2022-08-01 20:42:59 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: set flag config.rendered
2022-08-01 20:42:59 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:42:59 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Removed /etc/systemd/system/ceph-mds@ip-172-31-8-250.service.
2022-08-01 20:42:59 WARNING unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 Created symlink /etc/systemd/system/ceph-mds.target.wants/ceph-mds@ip-172-31-8-250.service → /lib/systemd/system/ceph-mds@.service.
2022-08-01 20:43:00 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 inactive
2022-08-01 20:43:00 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:43:00 DEBUG unit.ceph-fs/0.ceph-mds-relation-changed logger.go:60 active
2022-08-01 20:43:00 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-changed" hook (via explicit, bespoke hook script)
2022-08-01 20:43:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (30; unit: ceph-mon/2) hook" for ceph-fs/0
2022-08-01 20:43:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:43:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-changed (30; unit: ceph-mon/2) hook)
2022-08-01 20:43:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:43:00 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:43:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:43:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:43:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:43:00 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] idle: 
2022-08-01 20:44:49 DEBUG juju.worker.uniter.remotestate watcher.go:665 update status timer triggered for ceph-fs/0
2022-08-01 20:44:49 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:44:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:44:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:44:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:44:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for ceph-fs/0
2022-08-01 20:44:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run update-status hook)
2022-08-01 20:44:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run update-status hook)
2022-08-01 20:44:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for ceph-fs/0
2022-08-01 20:44:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for ceph-fs/0
2022-08-01 20:44:49 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:44:49 INFO unit.ceph-fs/0.juju-log server.go:319 Reactive main running for hook update-status
2022-08-01 20:44:49 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: starting handler dispatch, 63 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:44:49 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: hooks phase, 1 handlers queued
tracer: ++   queue handler reactive/layer_openstack.py:64:default_update_status
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer: set flag run-default-update-status
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer: set flag is-update-status-hook
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: main dispatch loop, 7 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
tracer: ++   queue handler reactive/layer_openstack.py:82:check_really_is_update_status
tracer: ++   queue handler reactive/layer_openstack.py:93:run_default_update_status
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: cleared flag run-default-update-status
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.update-status logger.go:60 active
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Request already sent but not complete, not sending new request
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: cleared flag ceph-mds.pools.available
tracer: -- dequeue handler reactive/ceph_fs.py:39:config_changed
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Request already sent but not complete, not sending new request
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Request already sent but not complete, not sending new request
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Setting ceph-client.pools.available
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: set flag ceph-mds.pools.available
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
2022-08-01 20:44:50 INFO unit.ceph-fs/0.juju-log server.go:319 Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.update-status logger.go:60 creating /var/lib/ceph/mds/ceph-ip-172-31-8-250/keyring
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.update-status logger.go:60 added entity mds.ip-172-31-8-250 auth(key=AQCrOuhiikuwNxAA0lhxx+kkCUmnMuxxoGt1Ow==)
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 Changing permissions on existing content: 33184 -> 416
2022-08-01 20:44:50 DEBUG unit.ceph-fs/0.juju-log server.go:319 Running _assess_status()
2022-08-01 20:44:51 DEBUG unit.ceph-fs/0.update-status logger.go:60 active
2022-08-01 20:44:51 DEBUG unit.ceph-fs/0.juju-log server.go:319 tracer>
tracer: cleared flag is-update-status-hook
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:44:51 INFO juju.worker.uniter.operation runhook.go:146 ran "update-status" hook (via explicit, bespoke hook script)
2022-08-01 20:44:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for ceph-fs/0
2022-08-01 20:44:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:44:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run update-status hook)
2022-08-01 20:44:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:44:51 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:44:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/0" already joined relation 30
2022-08-01 20:44:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/1" already joined relation 30
2022-08-01 20:44:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "ceph-mon/2" already joined relation 30
2022-08-01 20:46:28 DEBUG juju.worker.uniter.remotestate watcher.go:602 got relations change for ceph-fs/0: ok=true
2022-08-01 20:46:28 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:46:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-departed (30; unit: ceph-mon/0, departee: ceph-mon/0) hook for ceph-fs/0
2022-08-01 20:46:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/0, departee: ceph-mon/0) hook)
2022-08-01 20:46:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/0, departee: ceph-mon/0) hook)
2022-08-01 20:46:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-departed (30; unit: ceph-mon/0, departee: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:46:28 DEBUG juju.worker.uniter.remotestate watcher.go:498 got application change for ceph-fs/0
2022-08-01 20:46:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-departed (30; unit: ceph-mon/0, departee: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:46:29 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-departed hook for ceph-mon/0
2022-08-01 20:46:29 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:46:29 DEBUG juju.worker.uniter.remotestate watcher.go:488 got unit change for ceph-fs/0
2022-08-01 20:46:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-departed
2022-08-01 20:46:29 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag endpoint.ceph-mds.departed
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:29 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 64 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.departed
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:46:29 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:46:29 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 7 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:29 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:29 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[] map[] [ceph-mon/0]}}
2022-08-01 20:46:29 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[] map[] [ceph-mon/1]}}
2022-08-01 20:46:29 DEBUG juju.worker.uniter.remotestate watcher.go:659 got a relation units change for ceph-fs/0 : {30 {map[] map[] [ceph-mon/2]}}
2022-08-01 20:46:30 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:46:30 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:30 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 creating /var/lib/ceph/mds/ceph-ip-172-31-8-250/keyring
2022-08-01 20:46:30 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 added entity mds.ip-172-31-8-250 auth(key=AQCrOuhiikuwNxAA0lhxx+kkCUmnMuxxoGt1Ow==)
2022-08-01 20:46:30 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Writing file /etc/ceph/ceph.conf root:ceph 640
2022-08-01 20:46:32 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:46:33 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: cleared flag ceph-mds.pools.available
tracer: -- dequeue handler reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Setting ceph-client.pools.available
2022-08-01 20:46:33 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag ceph-mds.pools.available
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Setting ceph-client.pools.available
2022-08-01 20:46:33 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:33 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 creating /var/lib/ceph/mds/ceph-ip-172-31-8-250/keyring
2022-08-01 20:46:33 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 added entity mds.ip-172-31-8-250 auth(key=AQCrOuhiikuwNxAA0lhxx+kkCUmnMuxxoGt1Ow==)
2022-08-01 20:46:33 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Changing permissions on existing content: 33184 -> 416
2022-08-01 20:46:33 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:46:33 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:46:33 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-departed" hook (via explicit, bespoke hook script)
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-departed (30; unit: ceph-mon/0, departee: ceph-mon/0) hook" for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:46:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/0, departee: ceph-mon/0) hook)
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation resign leadership for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "resign leadership" for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "resign leadership" for ceph-fs/0
2022-08-01 20:46:34 WARNING juju.worker.uniter.operation leader.go:123 we should run a leader-deposed hook here, but we can't yet
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "resign leadership" for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-departed (30; unit: ceph-mon/1, departee: ceph-fs/0) hook for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/1, departee: ceph-fs/0) hook)
2022-08-01 20:46:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/1, departee: ceph-fs/0) hook)
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-departed (30; unit: ceph-mon/1, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-departed (30; unit: ceph-mon/1, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:34 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-departed hook for ceph-mon/1
2022-08-01 20:46:34 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:46:34 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-departed
2022-08-01 20:46:34 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 64 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.departed
tracer: set flag endpoint.ceph-mds.joined
2022-08-01 20:46:34 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:46:34 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 7 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:34 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:35 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:46:35 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:35 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 creating /var/lib/ceph/mds/ceph-ip-172-31-8-250/keyring
2022-08-01 20:46:35 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 added entity mds.ip-172-31-8-250 auth(key=AQCrOuhiikuwNxAA0lhxx+kkCUmnMuxxoGt1Ow==)
2022-08-01 20:46:35 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Writing file /etc/ceph/ceph.conf root:ceph 640
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:56:storage_ceph_connected
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:46:37 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: cleared flag ceph-mds.pools.available
tracer: -- dequeue handler reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Request already sent but not complete, not sending new request
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:31:joined:ceph-mds
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Setting ceph-client.pools.available
2022-08-01 20:46:37 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: set flag ceph-mds.pools.available
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: changed broker_req: [{'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_data', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 4.0}, {'app-name': 'cephfs', 'compression-algorithm': None, 'compression-max-blob-size': None, 'compression-max-blob-size-hdd': None, 'compression-max-blob-size-ssd': None, 'compression-min-blob-size': None, 'compression-min-blob-size-hdd': None, 'compression-min-blob-size-ssd': None, 'compression-mode': None, 'compression-required-ratio': None, 'group': None, 'group-namespace': None, 'max-bytes': None, 'max-objects': None, 'name': 'ceph-fs_metadata', 'op': 'create-pool', 'pg_num': None, 'rbd-mirroring-mode': 'pool', 'replicas': 3, 'weight': 1.0}, {'data_pool': 'ceph-fs_data', 'extra_pools': [], 'mds_name': 'ceph-fs', 'metadata_pool': 'ceph-fs_metadata', 'op': 'create-cephfs'}]
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Setting ceph-client.pools.available
2022-08-01 20:46:37 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:37 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 creating /var/lib/ceph/mds/ceph-ip-172-31-8-250/keyring
2022-08-01 20:46:37 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 added entity mds.ip-172-31-8-250 auth(key=AQCrOuhiikuwNxAA0lhxx+kkCUmnMuxxoGt1Ow==)
2022-08-01 20:46:37 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Changing permissions on existing content: 33184 -> 416
2022-08-01 20:46:37 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Running _assess_status()
2022-08-01 20:46:38 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:46:38 INFO juju.worker.uniter.operation runhook.go:146 ran "ceph-mds-relation-departed" hook (via explicit, bespoke hook script)
2022-08-01 20:46:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-departed (30; unit: ceph-mon/1, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:46:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/1, departee: ceph-fs/0) hook)
2022-08-01 20:46:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for ceph-fs/0
2022-08-01 20:46:38 DEBUG juju.worker.uniter resolver.go:171 no operations in progress; waiting for changes
2022-08-01 20:46:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook for ceph-fs/0
2022-08-01 20:46:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:38 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-departed hook for ceph-mon/2
2022-08-01 20:46:38 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:46:39 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-departed
2022-08-01 20:46:39 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: cleared flag endpoint.ceph-mds.joined
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:39 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 63 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.departed
2022-08-01 20:46:39 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:46:39 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 6 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:39 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:39 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:46:39 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:39 ERROR unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
    cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
    keyring_absolute_path = super().configure_ceph_keyring(
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
    subprocess.check_call(cmd)
  File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.8/subprocess.py", line 340, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
    self.pid = _posixsubprocess.fork_exec(
TypeError: expected str, bytes or os.PathLike object, not NoneType

2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 Traceback (most recent call last):
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/hooks/ceph-mds-relation-departed", line 22, in <module>
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     main()
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     bus.dispatch(restricted=restricted_mode)
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     _invoke(other_handlers)
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     handler.invoke()
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._action(*args)
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     keyring_absolute_path = super().configure_ceph_keyring(
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     subprocess.check_call(cmd)
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     retcode = call(*popenargs, **kwargs)
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 340, in call
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     with Popen(*popenargs, **kwargs) as p:
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._execute_child(args, executable, preexec_fn, close_fds,
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self.pid = _posixsubprocess.fork_exec(
2022-08-01 20:46:39 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 TypeError: expected str, bytes or os.PathLike object, not NoneType
2022-08-01 20:46:40 ERROR juju.worker.uniter.operation runhook.go:140 hook "ceph-mds-relation-departed" (via explicit, bespoke hook script) failed: exit status 1
2022-08-01 20:46:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:46:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:40 DEBUG juju.worker.uniter.operation executor.go:115 lock released for ceph-fs/0
2022-08-01 20:46:40 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:46:40 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] error: hook failed: "ceph-mds-relation-departed"
2022-08-01 20:46:45 DEBUG juju.worker.uniter.remotestate watcher.go:687 retry hook timer triggered for ceph-fs/0
2022-08-01 20:46:45 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:46:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook for ceph-fs/0
2022-08-01 20:46:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:45 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:45 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:45 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-departed hook for ceph-mon/2
2022-08-01 20:46:45 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:46:45 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-departed
2022-08-01 20:46:45 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: cleared flag endpoint.ceph-mds.joined
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:45 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 63 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.departed
2022-08-01 20:46:45 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:46:45 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 6 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:45 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:46 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:46:46 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:46 ERROR unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
    cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
    keyring_absolute_path = super().configure_ceph_keyring(
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
    subprocess.check_call(cmd)
  File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.8/subprocess.py", line 340, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
    self.pid = _posixsubprocess.fork_exec(
TypeError: expected str, bytes or os.PathLike object, not NoneType

2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 Traceback (most recent call last):
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/hooks/ceph-mds-relation-departed", line 22, in <module>
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     main()
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     bus.dispatch(restricted=restricted_mode)
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     _invoke(other_handlers)
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     handler.invoke()
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._action(*args)
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     keyring_absolute_path = super().configure_ceph_keyring(
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     subprocess.check_call(cmd)
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     retcode = call(*popenargs, **kwargs)
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 340, in call
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     with Popen(*popenargs, **kwargs) as p:
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._execute_child(args, executable, preexec_fn, close_fds,
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self.pid = _posixsubprocess.fork_exec(
2022-08-01 20:46:46 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 TypeError: expected str, bytes or os.PathLike object, not NoneType
2022-08-01 20:46:46 ERROR juju.worker.uniter.operation runhook.go:140 hook "ceph-mds-relation-departed" (via explicit, bespoke hook script) failed: exit status 1
2022-08-01 20:46:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:46:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:46 DEBUG juju.worker.uniter.operation executor.go:115 lock released for ceph-fs/0
2022-08-01 20:46:46 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:46:46 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] error: hook failed: "ceph-mds-relation-departed"
2022-08-01 20:46:56 DEBUG juju.worker.uniter.remotestate watcher.go:687 retry hook timer triggered for ceph-fs/0
2022-08-01 20:46:56 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:46:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook for ceph-fs/0
2022-08-01 20:46:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:46:56 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-departed hook for ceph-mon/2
2022-08-01 20:46:56 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:46:57 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-departed
2022-08-01 20:46:57 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: cleared flag endpoint.ceph-mds.joined
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:57 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 63 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.departed
2022-08-01 20:46:57 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:46:57 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 6 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:57 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:46:58 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:46:58 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:46:58 ERROR unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
    cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
    keyring_absolute_path = super().configure_ceph_keyring(
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
    subprocess.check_call(cmd)
  File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.8/subprocess.py", line 340, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
    self.pid = _posixsubprocess.fork_exec(
TypeError: expected str, bytes or os.PathLike object, not NoneType

2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 Traceback (most recent call last):
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/hooks/ceph-mds-relation-departed", line 22, in <module>
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     main()
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     bus.dispatch(restricted=restricted_mode)
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     _invoke(other_handlers)
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     handler.invoke()
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._action(*args)
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     keyring_absolute_path = super().configure_ceph_keyring(
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     subprocess.check_call(cmd)
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     retcode = call(*popenargs, **kwargs)
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 340, in call
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     with Popen(*popenargs, **kwargs) as p:
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._execute_child(args, executable, preexec_fn, close_fds,
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self.pid = _posixsubprocess.fork_exec(
2022-08-01 20:46:58 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 TypeError: expected str, bytes or os.PathLike object, not NoneType
2022-08-01 20:46:58 ERROR juju.worker.uniter.operation runhook.go:140 hook "ceph-mds-relation-departed" (via explicit, bespoke hook script) failed: exit status 1
2022-08-01 20:46:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:46:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:46:58 DEBUG juju.worker.uniter.operation executor.go:115 lock released for ceph-fs/0
2022-08-01 20:46:58 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:46:58 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] error: hook failed: "ceph-mds-relation-departed"
2022-08-01 20:47:18 DEBUG juju.worker.uniter.remotestate watcher.go:687 retry hook timer triggered for ceph-fs/0
2022-08-01 20:47:18 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:47:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook for ceph-fs/0
2022-08-01 20:47:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:47:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:47:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:47:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:47:18 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-departed hook for ceph-mon/2
2022-08-01 20:47:18 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:47:19 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-departed
2022-08-01 20:47:19 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: cleared flag endpoint.ceph-mds.joined
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:47:19 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 63 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.departed
2022-08-01 20:47:19 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:47:19 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 6 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:47:19 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:47:19 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:47:19 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:47:19 ERROR unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
    cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
    keyring_absolute_path = super().configure_ceph_keyring(
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
    subprocess.check_call(cmd)
  File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.8/subprocess.py", line 340, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
    self.pid = _posixsubprocess.fork_exec(
TypeError: expected str, bytes or os.PathLike object, not NoneType

2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 Traceback (most recent call last):
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/hooks/ceph-mds-relation-departed", line 22, in <module>
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     main()
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     bus.dispatch(restricted=restricted_mode)
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     _invoke(other_handlers)
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     handler.invoke()
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._action(*args)
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     keyring_absolute_path = super().configure_ceph_keyring(
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     subprocess.check_call(cmd)
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     retcode = call(*popenargs, **kwargs)
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 340, in call
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     with Popen(*popenargs, **kwargs) as p:
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._execute_child(args, executable, preexec_fn, close_fds,
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self.pid = _posixsubprocess.fork_exec(
2022-08-01 20:47:19 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 TypeError: expected str, bytes or os.PathLike object, not NoneType
2022-08-01 20:47:20 ERROR juju.worker.uniter.operation runhook.go:140 hook "ceph-mds-relation-departed" (via explicit, bespoke hook script) failed: exit status 1
2022-08-01 20:47:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:47:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:47:20 DEBUG juju.worker.uniter.operation executor.go:115 lock released for ceph-fs/0
2022-08-01 20:47:20 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:47:20 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] error: hook failed: "ceph-mds-relation-departed"
2022-08-01 20:47:59 DEBUG juju.worker.uniter.remotestate watcher.go:687 retry hook timer triggered for ceph-fs/0
2022-08-01 20:47:59 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:47:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook for ceph-fs/0
2022-08-01 20:47:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:47:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:47:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:47:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook" for ceph-fs/0
2022-08-01 20:47:59 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] executing: running ceph-mds-relation-departed hook for ceph-mon/2
2022-08-01 20:47:59 DEBUG juju.worker.uniter.runner runner.go:716 starting jujuc server  {unix @/var/lib/juju/agents/unit-ceph-fs-0/agent.socket <nil>}
2022-08-01 20:48:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Reactive main running for hook ceph-mds-relation-departed
2022-08-01 20:48:00 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: cleared flag endpoint.ceph-mds.joined
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:48:00 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: starting handler dispatch, 63 flags set
tracer: set flag ceph-fs-installed
tracer: set flag ceph-mds.available
tracer: set flag ceph-mds.connected
tracer: set flag ceph-mds.pools.available
tracer: set flag cephfs.configured
tracer: set flag charm.installed
tracer: set flag charms.openstack.do-default-charm.installed
tracer: set flag charms.openstack.do-default-config-rendered
tracer: set flag charms.openstack.do-default-config.changed
tracer: set flag charms.openstack.do-default-update-status
tracer: set flag charms.openstack.do-default-upgrade-charm
tracer: set flag config.default.bluestore-compression-algorithm
tracer: set flag config.default.bluestore-compression-max-blob-size
tracer: set flag config.default.bluestore-compression-max-blob-size-hdd
tracer: set flag config.default.bluestore-compression-max-blob-size-ssd
tracer: set flag config.default.bluestore-compression-min-blob-size
tracer: set flag config.default.bluestore-compression-min-blob-size-hdd
tracer: set flag config.default.bluestore-compression-min-blob-size-ssd
tracer: set flag config.default.bluestore-compression-mode
tracer: set flag config.default.bluestore-compression-required-ratio
tracer: set flag config.default.ceph-osd-replication-count
tracer: set flag config.default.ceph-pool-weight
tracer: set flag config.default.ceph-public-network
tracer: set flag config.default.ec-pool-weight
tracer: set flag config.default.ec-profile-crush-locality
tracer: set flag config.default.ec-profile-device-class
tracer: set flag config.default.ec-profile-durability-estimator
tracer: set flag config.default.ec-profile-helper-chunks
tracer: set flag config.default.ec-profile-k
tracer: set flag config.default.ec-profile-locality
tracer: set flag config.default.ec-profile-m
tracer: set flag config.default.ec-profile-name
tracer: set flag config.default.ec-profile-plugin
tracer: set flag config.default.ec-profile-scalar-mds
tracer: set flag config.default.ec-profile-technique
tracer: set flag config.default.key
tracer: set flag config.default.loglevel
tracer: set flag config.default.metadata-pool
tracer: set flag config.default.pool-type
tracer: set flag config.default.prefer-ipv6
tracer: set flag config.default.rbd-pool-name
tracer: set flag config.default.source
tracer: set flag config.default.use-syslog
tracer: set flag config.rendered
tracer: set flag config.set.ceph-osd-replication-count
tracer: set flag config.set.ceph-pool-weight
tracer: set flag config.set.ec-pool-weight
tracer: set flag config.set.ec-profile-k
tracer: set flag config.set.ec-profile-m
tracer: set flag config.set.ec-profile-plugin
tracer: set flag config.set.loglevel
tracer: set flag config.set.pool-type
tracer: set flag config.set.source
tracer: set flag endpoint.ceph-mds.changed
tracer: set flag endpoint.ceph-mds.changed.auth
tracer: set flag endpoint.ceph-mds.changed.broker-rsp-ceph-fs-0
tracer: set flag endpoint.ceph-mds.changed.ceph-public-address
tracer: set flag endpoint.ceph-mds.changed.egress-subnets
tracer: set flag endpoint.ceph-mds.changed.fsid
tracer: set flag endpoint.ceph-mds.changed.ingress-address
tracer: set flag endpoint.ceph-mds.changed.ip-172-31-8-250_mds_key
tracer: set flag endpoint.ceph-mds.changed.private-address
tracer: set flag endpoint.ceph-mds.departed
2022-08-01 20:48:00 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer: hooks phase, 0 handlers queued
2022-08-01 20:48:00 DEBUG unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: tracer>
tracer: main dispatch loop, 6 handlers queued
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:35:changed:ceph-mds
tracer: ++   queue handler hooks/relations/ceph-mds/requires.py:39:departed:ceph-mds
tracer: ++   queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates
tracer: ++   queue handler reactive/ceph_fs.py:39:config_changed
tracer: ++   queue handler reactive/ceph_fs.py:56:storage_ceph_connected
tracer: ++   queue handler reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:48:00 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/layer_openstack.py:168:default_config_rendered
2022-08-01 20:48:01 DEBUG unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 active
2022-08-01 20:48:01 INFO unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Invoking reactive handler: reactive/ceph_fs.py:39:config_changed
2022-08-01 20:48:01 ERROR unit.ceph-fs/0.juju-log server.go:319 ceph-mds:30: Hook error:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
    bus.dispatch(restricted=restricted_mode)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
    _invoke(other_handlers)
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
    handler.invoke()
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
    self._action(*args)
  File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
    cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
    keyring_absolute_path = super().configure_ceph_keyring(
  File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
    subprocess.check_call(cmd)
  File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.8/subprocess.py", line 340, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
    self.pid = _posixsubprocess.fork_exec(
TypeError: expected str, bytes or os.PathLike object, not NoneType

2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 Traceback (most recent call last):
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/hooks/ceph-mds-relation-departed", line 22, in <module>
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     main()
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     bus.dispatch(restricted=restricted_mode)
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     _invoke(other_handlers)
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     handler.invoke()
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._action(*args)
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/charm/reactive/ceph_fs.py", line 44, in config_changed
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     cephfs_charm.configure_ceph_keyring(ceph_mds.mds_key())
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 392, in configure_ceph_keyring
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     keyring_absolute_path = super().configure_ceph_keyring(
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/var/lib/juju/agents/unit-ceph-fs-0/.venv/lib/python3.8/site-packages/charms_openstack/plugins/classes.py", line 192, in configure_ceph_keyring
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     subprocess.check_call(cmd)
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 359, in check_call
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     retcode = call(*popenargs, **kwargs)
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 340, in call
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     with Popen(*popenargs, **kwargs) as p:
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 858, in __init__
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self._execute_child(args, executable, preexec_fn, close_fds,
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 1639, in _execute_child
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60     self.pid = _posixsubprocess.fork_exec(
2022-08-01 20:48:01 WARNING unit.ceph-fs/0.ceph-mds-relation-departed logger.go:60 TypeError: expected str, bytes or os.PathLike object, not NoneType
2022-08-01 20:48:01 ERROR juju.worker.uniter.operation runhook.go:140 hook "ceph-mds-relation-departed" (via explicit, bespoke hook script) failed: exit status 1
2022-08-01 20:48:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-08-01 20:48:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for ceph-fs/0 uniter (run relation-departed (30; unit: ceph-mon/2, departee: ceph-fs/0) hook)
2022-08-01 20:48:01 DEBUG juju.worker.uniter.operation executor.go:115 lock released for ceph-fs/0
2022-08-01 20:48:01 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-departed" hook
2022-08-01 20:48:01 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] error: hook failed: "ceph-mds-relation-departed"