(venv) ubuntu@lmlogiudice-bastion:~/src/charm-ceph-mon$ tox -e func-target -- focal-wallaby func-target create: /home/ubuntu/src/charm-ceph-mon/.tox/func-target func-target installdeps: -r/home/ubuntu/src/charm-ceph-mon/test-requirements.txt func-target installed: aiohttp==3.9.4,aiosignal==1.3.1,aodhclient==1.3.0,appdirs==1.4.4,argcomplete==3.3.0,async-generator==1.10,async-timeout==4.0.3,attrs==23.2.0,Babel==2.14.0,bcrypt==4.1.2,boto3==1.34.84,botocore==1.34.84,cachetools==5.3.3,certifi==2024.2.2,cffi==1.16.0,charset-normalizer==3.3.2,cliff==2.18.0,cmd2==0.8.9,colorclass==2.2.2,coverage==7.4.4,croniter==2.0.3,cryptography==3.3.2,debtcollector==3.0.0,decorator==5.1.1,defusedxml==0.7.1,dnspython==2.6.1,dogpile.cache==1.3.2,extras==1.0.0,fasteners==0.19,fixtures==4.1.0,frozenlist==1.4.1,futurist==1.10.0,gnocchiclient==7.0.8,google-auth==2.29.0,hvac==0.6.4,idna==3.7,importlib-resources==6.4.0,iso8601==2.1.0,Jinja2==3.1.3,jmespath==1.0.1,jsonpatch==1.33,jsonpointer==2.4,jsonschema==4.21.1,jsonschema-specifications==2023.12.1,juju==2.9.46.1,juju-wait==2.8.4,jujubundlelib==0.5.7,keystoneauth1==5.6.0,kubernetes==29.0.0,lxml==5.2.1,macaroonbakery==1.3.2,MarkupSafe==2.1.5,mock==5.1.0,msgpack==1.0.8,multidict==6.0.5,mypy-extensions==1.0.0,netaddr==1.2.1,netifaces==0.11.0,oauthlib==3.2.2,openstacksdk==3.0.0,os-client-config==2.1.0,os-service-types==1.7.0,osc-lib==3.0.1,oslo.concurrency==6.0.0,oslo.config==6.11.3,oslo.context==5.5.0,oslo.i18n==6.3.0,oslo.log==5.5.1,oslo.serialization==5.4.0,oslo.utils==7.1.0,osprofiler==4.1.0,packaging==24.0,paramiko==3.4.0,pbr==6.0.0,pika==1.3.2,pkgutil-resolve-name==1.3.10,platformdirs==4.2.0,prettytable==0.7.2,protobuf==3.20.3,pyasn1==0.6.0,pyasn1-modules==0.4.0,pycparser==2.22,pyinotify==0.9.6,pymacaroons==0.13.0,pymongo==4.6.3,PyNaCl==1.5.0,pyOpenSSL==22.0.0,pyparsing==2.4.7,pyperclip==1.8.2,pyRFC3339==1.1,python-barbicanclient==4.10.0,python-ceilometerclient==2.9.0,python-cinderclient==5.0.2,python-dateutil==2.9.0.post0,python-designateclient==2.12.0,python-glanceclient==2.17.1,python-heatclient==1.18.1,python-ironicclient==5.5.0,python-keystoneclient==3.21.0,python-libmaas==0.6.8,python-manilaclient==1.29.0,python-neutronclient==6.14.1,python-novaclient==15.1.1,python-octaviaclient==1.10.1,python-openstackclient==6.6.0,python-subunit==1.4.4,python-swiftclient==3.8.1,pytz==2024.1,pyudev==0.24.1,PyYAML==6.0.1,referencing==0.34.0,requests==2.31.0,requests-oauthlib==2.0.0,requestsexceptions==1.4.0,rfc3986==2.0.0,rpds-py==0.18.0,rsa==4.9,s3transfer==0.10.1,simplejson==3.19.2,six==1.16.0,stestr==4.1.0,stevedore==5.2.0,tempest==38.0.1.dev15,tenacity==8.2.3,terminaltables==3.1.10,testtools==2.7.1,theblues==0.5.2,tomlkit==0.12.4,toposort==1.10,typing-extensions==4.11.0,typing-inspect==0.9.0,ujson==5.9.0,urllib3==2.2.1,voluptuous==0.14.2,warlock==1.3.3,wcwidth==0.2.13,WebOb==1.8.7,websocket-client==1.7.0,websockets==7.0,wrapt==1.16.0,yarl==1.9.4,zaza==0.0.2.dev1,zaza.openstack==0.0.1.dev1,zipp==3.18.1 func-target run-test-pre: PYTHONHASHSEED='0' func-target run-test: commands[0] | functest-run-suite --keep-model --bundle focal-wallaby 2024-04-15 21:46:01 [INFO] Could not determine correct model aliasfrom tests.yaml, using default 2024-04-15 21:46:06 [INFO] Deploying bundle '/home/ubuntu/src/charm-ceph-mon/tests/bundles/focal-wallaby.yaml' on to 'zaza-aaf142bef3ef' model 2024-04-15 21:46:13 [INFO] Located charm "ceph-mon" in charm-hub, channel pacific/stable 2024-04-15 21:46:14 [INFO] Located charm "ceph-osd" in charm-hub, channel pacific/stable 2024-04-15 21:46:15 [INFO] Located charm "cinder" in charm-hub, channel wallaby/stable 2024-04-15 21:46:16 [INFO] Located charm "cinder-ceph" in charm-hub, channel wallaby/stable 2024-04-15 21:46:17 [INFO] Located charm "mysql-router" in charm-hub, channel 8.0.19/edge 2024-04-15 21:46:18 [INFO] Located charm "glance" in charm-hub, channel wallaby/stable 2024-04-15 21:46:19 [INFO] Located charm "mysql-router" in charm-hub, channel 8.0.19/edge 2024-04-15 21:46:20 [INFO] Located charm "keystone" in charm-hub, channel wallaby/stable 2024-04-15 21:46:21 [INFO] Located charm "mysql-router" in charm-hub, channel 8.0.19/edge 2024-04-15 21:46:22 [INFO] Located charm "mysql-innodb-cluster" in charm-hub, channel 8.0.19/edge 2024-04-15 21:46:23 [INFO] Located charm "nova-cloud-controller" in charm-hub, channel wallaby/stable 2024-04-15 21:46:24 [INFO] Located charm "mysql-router" in charm-hub, channel 8.0.19/edge 2024-04-15 21:46:25 [INFO] Located charm "nova-compute" in charm-hub, channel wallaby/stable 2024-04-15 21:46:26 [INFO] Located charm "placement" in charm-hub, channel wallaby/stable 2024-04-15 21:46:26 [INFO] Located charm "mysql-router" in charm-hub, channel 8.0.19/edge 2024-04-15 21:46:27 [INFO] Located charm "prometheus2" in charm-hub, channel stable 2024-04-15 21:46:28 [INFO] Located charm "rabbitmq-server" in charm-hub, channel 3.8/stable 2024-04-15 21:46:44 [INFO] Executing changes: 2024-04-15 21:46:44 [INFO] - upload charm ceph-mon from charm-hub for series focal from channel pacific/edge with architecture=amd64 2024-04-15 21:46:48 [INFO] - deploy application ceph-mon from charm-hub on focal with pacific/edge 2024-04-15 21:46:48 [INFO] - upload charm ceph-osd from charm-hub for series focal from channel pacific/edge with architecture=amd64 2024-04-15 21:46:50 [INFO] - deploy application ceph-osd from charm-hub on focal with pacific/edge 2024-04-15 21:46:51 [INFO] - upload charm cinder from charm-hub for series focal from channel wallaby/edge with architecture=amd64 2024-04-15 21:46:53 [INFO] - deploy application cinder from charm-hub on focal with wallaby/edge 2024-04-15 21:46:54 [INFO] added resource policyd-override 2024-04-15 21:46:54 [INFO] - expose all endpoints of cinder and allow access from CIDRs 0.0.0.0/0 and ::/0 2024-04-15 21:46:54 [INFO] - upload charm cinder-ceph from charm-hub for series focal from channel wallaby/edge with architecture=amd64 2024-04-15 21:46:56 [INFO] - deploy application cinder-ceph from charm-hub on focal with wallaby/edge 2024-04-15 21:46:56 [INFO] - upload charm mysql-router from charm-hub for series focal from channel 8.0.19/edge with architecture=amd64 2024-04-15 21:46:59 [INFO] - deploy application cinder-mysql-router from charm-hub on focal with 8.0.19/edge using mysql-router 2024-04-15 21:46:59 [INFO] - upload charm glance from charm-hub for series focal from channel wallaby/edge with architecture=amd64 2024-04-15 21:47:01 [INFO] - deploy application glance from charm-hub on focal with wallaby/edge 2024-04-15 21:47:02 [INFO] added resource policyd-override 2024-04-15 21:47:02 [INFO] - expose all endpoints of glance and allow access from CIDRs 0.0.0.0/0 and ::/0 2024-04-15 21:47:02 [INFO] - deploy application glance-mysql-router from charm-hub on focal with 8.0.19/edge using mysql-router 2024-04-15 21:47:02 [INFO] - upload charm keystone from charm-hub for series focal from channel wallaby/edge with architecture=amd64 2024-04-15 21:47:04 [INFO] - deploy application keystone from charm-hub on focal with wallaby/edge 2024-04-15 21:47:05 [INFO] added resource policyd-override 2024-04-15 21:47:05 [INFO] - expose all endpoints of keystone and allow access from CIDRs 0.0.0.0/0 and ::/0 2024-04-15 21:47:05 [INFO] - deploy application keystone-mysql-router from charm-hub on focal with 8.0.19/edge using mysql-router 2024-04-15 21:47:05 [INFO] - upload charm mysql-innodb-cluster from charm-hub for series focal from channel 8.0.19/edge with architecture=amd64 2024-04-15 21:47:08 [INFO] - deploy application mysql-innodb-cluster from charm-hub on focal with 8.0.19/edge 2024-04-15 21:47:09 [INFO] added resource mysql-shell 2024-04-15 21:47:09 [INFO] - upload charm nova-cloud-controller from charm-hub for series focal from channel wallaby/edge with architecture=amd64 2024-04-15 21:47:11 [INFO] - deploy application nova-cloud-controller from charm-hub on focal with wallaby/edge 2024-04-15 21:47:11 [INFO] added resource policyd-override 2024-04-15 21:47:11 [INFO] - expose all endpoints of nova-cloud-controller and allow access from CIDRs 0.0.0.0/0 and ::/0 2024-04-15 21:47:11 [INFO] - deploy application nova-cloud-controller-mysql-router from charm-hub on focal with 8.0.19/edge using mysql-router 2024-04-15 21:47:12 [INFO] - upload charm nova-compute from charm-hub for series focal from channel wallaby/edge with architecture=amd64 2024-04-15 21:47:14 [INFO] - deploy application nova-compute from charm-hub on focal with wallaby/edge 2024-04-15 21:47:14 [INFO] - upload charm placement from charm-hub for series focal from channel wallaby/edge with architecture=amd64 2024-04-15 21:47:17 [INFO] - deploy application placement from charm-hub on focal with wallaby/edge 2024-04-15 21:47:17 [INFO] - deploy application placement-mysql-router from charm-hub on focal with 8.0.19/edge using mysql-router 2024-04-15 21:47:18 [INFO] - upload charm prometheus2 from charm-hub for series focal with architecture=amd64 2024-04-15 21:47:19 [INFO] - deploy application prometheus2 from charm-hub on focal 2024-04-15 21:47:20 [INFO] added resource core 2024-04-15 21:47:20 [INFO] added resource prometheus 2024-04-15 21:47:20 [INFO] - upload charm rabbitmq-server from charm-hub for series focal from channel 3.8/edge with architecture=amd64 2024-04-15 21:47:22 [INFO] - deploy application rabbitmq-server from charm-hub on focal with 3.8/edge 2024-04-15 21:47:22 [INFO] - add new machine 0 2024-04-15 21:47:22 [INFO] - add new machine 1 2024-04-15 21:47:22 [INFO] - add new machine 2 2024-04-15 21:47:22 [INFO] - add new machine 3 2024-04-15 21:47:23 [INFO] - add new machine 4 2024-04-15 21:47:23 [INFO] - add new machine 5 2024-04-15 21:47:23 [INFO] - add new machine 6 2024-04-15 21:47:23 [INFO] - add new machine 7 2024-04-15 21:47:23 [INFO] - add new machine 8 2024-04-15 21:47:24 [INFO] - add new machine 9 2024-04-15 21:47:24 [INFO] - add new machine 10 2024-04-15 21:47:24 [INFO] - add new machine 11 2024-04-15 21:47:24 [INFO] - add new machine 12 2024-04-15 21:47:24 [INFO] - add new machine 13 2024-04-15 21:47:24 [INFO] - add new machine 14 2024-04-15 21:47:25 [INFO] - add new machine 15 2024-04-15 21:47:25 [INFO] - add new machine 16 2024-04-15 21:47:25 [INFO] - add relation nova-compute:amqp - rabbitmq-server:amqp 2024-04-15 21:47:25 [INFO] - add relation nova-compute:image-service - glance:image-service 2024-04-15 21:47:25 [INFO] - add relation nova-compute:ceph - ceph-mon:client 2024-04-15 21:47:25 [INFO] - add relation nova-compute:ceph-access - cinder-ceph:ceph-access 2024-04-15 21:47:25 [INFO] - add relation keystone:shared-db - keystone-mysql-router:shared-db 2024-04-15 21:47:26 [INFO] - add relation keystone-mysql-router:db-router - mysql-innodb-cluster:db-router 2024-04-15 21:47:26 [INFO] - add relation glance:shared-db - glance-mysql-router:shared-db 2024-04-15 21:47:26 [INFO] - add relation glance-mysql-router:db-router - mysql-innodb-cluster:db-router 2024-04-15 21:47:26 [INFO] - add relation glance:identity-service - keystone:identity-service 2024-04-15 21:47:26 [INFO] - add relation glance:amqp - rabbitmq-server:amqp 2024-04-15 21:47:26 [INFO] - add relation glance:ceph - ceph-mon:client 2024-04-15 21:47:26 [INFO] - add relation cinder:shared-db - cinder-mysql-router:shared-db 2024-04-15 21:47:26 [INFO] - add relation cinder-mysql-router:db-router - mysql-innodb-cluster:db-router 2024-04-15 21:47:26 [INFO] - add relation cinder:identity-service - keystone:identity-service 2024-04-15 21:47:27 [INFO] - add relation cinder:amqp - rabbitmq-server:amqp 2024-04-15 21:47:27 [INFO] - add relation cinder:image-service - glance:image-service 2024-04-15 21:47:27 [INFO] - add relation cinder-ceph:storage-backend - cinder:storage-backend 2024-04-15 21:47:27 [INFO] - add relation cinder-ceph:ceph - ceph-mon:client 2024-04-15 21:47:27 [INFO] - add relation ceph-osd:mon - ceph-mon:osd 2024-04-15 21:47:27 [INFO] - add relation nova-cloud-controller:shared-db - nova-cloud-controller-mysql-router:shared-db 2024-04-15 21:47:27 [INFO] - add relation nova-cloud-controller-mysql-router:db-router - mysql-innodb-cluster:db-router 2024-04-15 21:47:27 [INFO] - add relation nova-cloud-controller:identity-service - keystone:identity-service 2024-04-15 21:47:28 [INFO] - add relation nova-cloud-controller:amqp - rabbitmq-server:amqp 2024-04-15 21:47:28 [INFO] - add relation nova-cloud-controller:cloud-compute - nova-compute:cloud-compute 2024-04-15 21:47:28 [INFO] - add relation nova-cloud-controller:image-service - glance:image-service 2024-04-15 21:47:28 [INFO] - add relation placement:shared-db - placement-mysql-router:shared-db 2024-04-15 21:47:28 [INFO] - add relation placement-mysql-router:db-router - mysql-innodb-cluster:db-router 2024-04-15 21:47:28 [INFO] - add relation placement - keystone 2024-04-15 21:47:28 [INFO] - add relation placement - nova-cloud-controller 2024-04-15 21:47:28 [INFO] - add relation ceph-mon:prometheus - prometheus2:target 2024-04-15 21:47:29 [INFO] - add unit ceph-mon/0 to new machine 6 2024-04-15 21:47:29 [INFO] - add unit ceph-mon/1 to new machine 7 2024-04-15 21:47:29 [INFO] - add unit ceph-mon/2 to new machine 8 2024-04-15 21:47:29 [INFO] - add unit ceph-osd/0 to new machine 3 2024-04-15 21:47:30 [INFO] - add unit ceph-osd/1 to new machine 4 2024-04-15 21:47:31 [INFO] - add unit ceph-osd/2 to new machine 5 2024-04-15 21:47:33 [INFO] - add unit cinder/0 to new machine 13 2024-04-15 21:47:33 [INFO] - add unit glance/0 to new machine 12 2024-04-15 21:47:33 [INFO] - add unit keystone/0 to new machine 10 2024-04-15 21:47:33 [INFO] - add unit mysql-innodb-cluster/0 to new machine 0 2024-04-15 21:47:33 [INFO] - add unit mysql-innodb-cluster/1 to new machine 1 2024-04-15 21:47:34 [INFO] - add unit mysql-innodb-cluster/2 to new machine 2 2024-04-15 21:47:34 [INFO] - add unit nova-cloud-controller/0 to new machine 14 2024-04-15 21:47:34 [INFO] - add unit nova-compute/0 to new machine 11 2024-04-15 21:47:34 [INFO] - add unit placement/0 to new machine 15 2024-04-15 21:47:34 [INFO] - add unit prometheus2/0 to new machine 16 2024-04-15 21:47:35 [INFO] - add unit rabbitmq-server/0 to new machine 9 2024-04-15 21:47:35 [INFO] Deploy of bundle completed. 2024-04-15 21:47:35 [INFO] Waiting for environment to settle 2024-04-15 21:47:35 [INFO] Timeout for deployment to settle set to: 3600 2024-04-15 21:47:35 [INFO] Maximum resolve count for deployment set to: 0 2024-04-15 21:47:35 [INFO] Waiting for application states to reach targeted states. 2024-04-15 21:47:36 [INFO] Waiting for an application to be present 2024-04-15 21:47:36 [INFO] Now checking workload status and status messages 2024-04-15 21:52:21 [INFO] Application rabbitmq-server is ready. 2024-04-15 21:57:05 [INFO] Application ceph-osd is ready. 2024-04-15 21:57:20 [INFO] Application ceph-mon is ready. 2024-04-15 21:59:03 [INFO] Application nova-compute is ready. 2024-04-15 22:01:40 [INFO] Application prometheus2 is ready. 2024-04-15 22:06:00 [INFO] Application nova-cloud-controller-mysql-router is ready. 2024-04-15 22:06:08 [INFO] Application placement-mysql-router is ready. 2024-04-15 22:06:18 [INFO] Application keystone-mysql-router is ready. 2024-04-15 22:06:29 [INFO] Application glance-mysql-router is ready. 2024-04-15 22:06:39 [INFO] Application mysql-innodb-cluster is ready. 2024-04-15 22:13:16 [INFO] Application cinder-mysql-router is ready. 2024-04-15 22:13:56 [INFO] Application keystone is ready. 2024-04-15 22:14:01 [INFO] Application placement is ready. 2024-04-15 22:14:03 [INFO] Application cinder-ceph is ready. 2024-04-15 22:14:08 [INFO] Application glance is ready. 2024-04-15 22:15:46 [INFO] Application cinder is ready. 2024-04-15 22:17:50 [INFO] Application nova-cloud-controller is ready. 2024-04-15 22:17:50 [INFO] All applications reached approved status, number of units (where relevant), and workload status message checks. 2024-04-15 22:17:51 [INFO] Waiting for zaza-aaf142bef3ef to settle 2024-04-15 22:17:54 [INFO] Image architecture set to amd64 2024-04-15 22:18:05 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:18:09 [INFO] Using keystone API V3 (or later) for overcloud auth scp: /usr/local/share/ca-certificates/keystone_juju_ca_cert.crt: No such file or directory 2024-04-15 22:18:15 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:18:27 [INFO] Downloading image bionic 2024-04-15 22:18:27 [INFO] Downloading http://cloud-images.ubuntu.com/bionic/current/bionic-server-cloudimg-amd64.img ... 2024-04-15 22:19:12 [INFO] Image status wait: resource f208ff7f-cc8b-4d42-92d2-c6f9db5f7f86 in active state, waiting for active 2024-04-15 22:19:12 [INFO] Setting image properties: None 2024-04-15 22:19:12 [INFO] ## Running Test zaza.openstack.charm_tests.ceph.tests.CheckPoolTypes ## 2024-04-15 22:19:12 [INFO] test_check_pool_types (zaza.openstack.charm_tests.ceph.tests.CheckPoolTypes) 2024-04-15 22:19:12 [INFO] Check type of pools created for clients. 2024-04-15 22:19:12 [INFO] ... 2024-04-15 22:19:17 [INFO] Checking glance is replicated 2024-04-15 22:19:19 [INFO] Checking nova is replicated 2024-04-15 22:19:22 [INFO] Checking cinder-ceph is replicated 2024-04-15 22:19:22 [INFO] ok 2024-04-15 22:19:22 [INFO] ---------------------------------------------------------------------- 2024-04-15 22:19:22 [INFO] Ran 1 test in 10.567s 2024-04-15 22:19:22 [INFO] OK 2024-04-15 22:19:22 [INFO] ## Running Test zaza.openstack.charm_tests.ceph.tests.CephLowLevelTest ## 2024-04-15 22:19:35 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:19:39 [INFO] Using keystone API V3 (or later) for overcloud auth scp: /usr/local/share/ca-certificates/keystone_juju_ca_cert.crt: No such file or directory 2024-04-15 22:19:44 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:20:00 [INFO] test_pg_tuning (zaza.openstack.charm_tests.ceph.tests.CephLowLevelTest) 2024-04-15 22:20:00 [INFO] ... 2024-04-15 22:20:09 [INFO] ok 2024-04-15 22:20:09 [INFO] test_processes (zaza.openstack.charm_tests.ceph.tests.CephLowLevelTest) 2024-04-15 22:20:09 [INFO] Verify Ceph processes. 2024-04-15 22:20:09 [INFO] ... 2024-04-15 22:20:09 [INFO] Checking ceph-mon and ceph-osd processes... 2024-04-15 22:20:18 [INFO] ok 2024-04-15 22:20:18 [INFO] test_services (zaza.openstack.charm_tests.ceph.tests.CephLowLevelTest) 2024-04-15 22:20:18 [INFO] Verify the ceph services. 2024-04-15 22:20:18 [INFO] ... 2024-04-15 22:20:18 [INFO] Checking ceph-osd and ceph-mon services... 2024-04-15 22:20:29 [INFO] ok 2024-04-15 22:20:29 [INFO] ---------------------------------------------------------------------- 2024-04-15 22:20:29 [INFO] Ran 3 tests in 66.930s 2024-04-15 22:20:29 [INFO] OK 2024-04-15 22:20:29 [INFO] ## Running Test zaza.openstack.charm_tests.ceph.tests.CephRelationTest ## 2024-04-15 22:20:40 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:20:44 [INFO] Using keystone API V3 (or later) for overcloud auth scp: /usr/local/share/ca-certificates/keystone_juju_ca_cert.crt: No such file or directory 2024-04-15 22:20:50 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:20:55 [INFO] test_ceph0_to_ceph_osd_relation (zaza.openstack.charm_tests.ceph.tests.CephRelationTest) 2024-04-15 22:20:55 [INFO] Verify the ceph0 to ceph-osd relation data. 2024-04-15 22:20:55 [INFO] ... 2024-04-15 22:20:55 [INFO] Checking ceph-mon/0:ceph-osd mon relation data... 2024-04-15 22:21:03 [INFO] ok 2024-04-15 22:21:03 [INFO] test_ceph1_to_ceph_osd_relation (zaza.openstack.charm_tests.ceph.tests.CephRelationTest) 2024-04-15 22:21:03 [INFO] Verify the ceph1 to ceph-osd relation data. 2024-04-15 22:21:03 [INFO] ... 2024-04-15 22:21:03 [INFO] Checking ceph-mon/1:ceph-osd mon relation data... 2024-04-15 22:21:10 [INFO] ok 2024-04-15 22:21:10 [INFO] test_ceph2_to_ceph_osd_relation (zaza.openstack.charm_tests.ceph.tests.CephRelationTest) 2024-04-15 22:21:10 [INFO] Verify the ceph2 to ceph-osd relation data. 2024-04-15 22:21:10 [INFO] ... 2024-04-15 22:21:10 [INFO] Checking ceph-mon/2:ceph-osd mon relation data... 2024-04-15 22:21:17 [INFO] ok 2024-04-15 22:21:17 [INFO] test_ceph_osd_ceph_relation_address (zaza.openstack.charm_tests.ceph.tests.CephRelationTest) 2024-04-15 22:21:17 [INFO] Verify the ceph-osd to ceph relation data. 2024-04-15 22:21:17 [INFO] ... 2024-04-15 22:21:17 [INFO] Checking ceph-osd:ceph-mon relation data... 2024-04-15 22:21:23 [INFO] ok 2024-04-15 22:21:23 [INFO] ---------------------------------------------------------------------- 2024-04-15 22:21:23 [INFO] Ran 4 tests in 53.674s 2024-04-15 22:21:23 [INFO] OK 2024-04-15 22:21:23 [INFO] ## Running Test zaza.openstack.charm_tests.ceph.tests.CephTest ## 2024-04-15 22:21:36 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:21:40 [INFO] Using keystone API V3 (or later) for overcloud auth scp: /usr/local/share/ca-certificates/keystone_juju_ca_cert.crt: No such file or directory 2024-04-15 22:21:45 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:21:48 [INFO] test_blacklist (zaza.openstack.charm_tests.ceph.tests.CephTest) 2024-04-15 22:21:48 [INFO] Check the blacklist action. 2024-04-15 22:21:48 [INFO] ... 2024-04-15 22:21:48 [INFO] Checking blacklist-add-disk andblacklist-remove-disk actions... 2024-04-15 22:22:11 [INFO] ok 2024-04-15 22:22:11 [INFO] test_blocked_when_non_pristine_disk_appears (zaza.openstack.charm_tests.ceph.tests.CephTest) 2024-04-15 22:22:11 [INFO] Test blocked state with non-pristine disk. 2024-04-15 22:22:11 [INFO] ... 2024-04-15 22:22:23 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:22:27 [WARNING] Skipping pristine disk test for focal and higher 2024-04-15 22:22:27 [INFO] ok 2024-04-15 22:22:27 [INFO] test_ceph_check_osd_pools (zaza.openstack.charm_tests.ceph.tests.CephTest) 2024-04-15 22:22:27 [INFO] Check OSD pools. 2024-04-15 22:22:27 [INFO] ... 2024-04-15 22:22:27 [INFO] Checking pools on ceph units... 2024-04-15 22:22:37 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:22:43 [INFO] ok 2024-04-15 22:22:43 [INFO] test_ceph_encryption (zaza.openstack.charm_tests.ceph.tests.CephTest) 2024-04-15 22:22:43 [INFO] Test Ceph encryption. 2024-04-15 22:22:43 [INFO] ... 2024-04-15 22:22:52 [INFO] looking at application: {'name': 'keystone', 'type': {'pkg': 'keystone', 'origin_setting': 'openstack-origin'}} 2024-04-15 22:22:55 [WARNING] Skipping encryption test for Mitaka and higher 2024-04-15 22:22:55 [INFO] ok 2024-04-15 22:22:55 [INFO] test_ceph_pool_creation_with_text_file (zaza.openstack.charm_tests.ceph.tests.CephTest) 2024-04-15 22:22:55 [INFO] Check the creation of a pool and a text file. 2024-04-15 22:22:55 [INFO] ... 2024-04-15 22:23:01 [INFO] ok 2024-04-15 22:23:01 [INFO] test_list_disks (zaza.openstack.charm_tests.ceph.tests.CephTest) 2024-04-15 22:23:01 [INFO] Test the list-disks action. 2024-04-15 22:23:01 [INFO] ... 2024-04-15 22:23:01 [INFO] Checking list-disks action... 2024-04-15 22:23:09 [INFO] ok 2024-04-15 22:23:09 [INFO] test_pause_and_resume (zaza.openstack.charm_tests.ceph.tests.CephTest) 2024-04-15 22:23:09 [INFO] The services can be paused and resumed. 2024-04-15 22:23:09 [INFO] ... 2024-04-15 22:23:09 [INFO] Checking pause and resume actions... 2024-04-15 22:23:09 [INFO] ok 2024-04-15 22:23:09 [INFO] ---------------------------------------------------------------------- 2024-04-15 22:23:09 [INFO] Ran 7 tests in 105.684s 2024-04-15 22:23:09 [INFO] OK 2024-04-15 22:23:09 [INFO] ## Running Test zaza.openstack.charm_tests.ceph.osd.tests.SecurityTest ## 2024-04-15 22:23:09 [INFO] test_osd_security_checklist (zaza.openstack.charm_tests.ceph.osd.tests.SecurityTest) 2024-04-15 22:23:09 [INFO] Verify expected state with security-checklist. 2024-04-15 22:23:09 [INFO] ... 2024-04-15 22:23:09 [INFO] Running `security-checklist` action on Ceph OSD leader unit 2024-04-15 22:23:12 [INFO] ok 2024-04-15 22:23:12 [INFO] ---------------------------------------------------------------------- 2024-04-15 22:23:12 [INFO] Ran 1 test in 3.307s 2024-04-15 22:23:12 [INFO] OK 2024-04-15 22:23:12 [INFO] ## Running Test zaza.openstack.charm_tests.ceph.tests.CephPrometheusTest ## 2024-04-15 22:23:12 [INFO] test_prometheus_metrics (zaza.openstack.charm_tests.ceph.tests.CephPrometheusTest) 2024-04-15 22:23:12 [INFO] Validate that Prometheus has Ceph metrics. 2024-04-15 22:23:12 [INFO] ... 2024-04-15 22:23:17 [INFO] ok 2024-04-15 22:23:17 [INFO] ---------------------------------------------------------------------- 2024-04-15 22:23:17 [INFO] Ran 1 test in 5.170s 2024-04-15 22:23:17 [INFO] OK 2024-04-15 22:23:17 [INFO] Events: Configure zaza.openstack.charm_tests.glance.setup.add_lts_image: Start: 1713219473.3381732 Finish: 1713219552.4053304 Elapsed Time: 79.06715726852417 PCT Of Run Time: 4 Deploy Bundle: Start: 1713217566.8045628 Finish: 1713217655.9175 Elapsed Time: 89.11293721199036 PCT Of Run Time: 4 Prepare Environment: Start: 1713217561.9191198 Finish: 1713217566.8043957 Elapsed Time: 4.885275840759277 PCT Of Run Time: 1 Test zaza.openstack.charm_tests.ceph.osd.tests.SecurityTest: Start: 1713219789.2892342 Finish: 1713219792.6016865 Elapsed Time: 3.3124523162841797 PCT Of Run Time: 1 Test zaza.openstack.charm_tests.ceph.tests.CephLowLevelTest: Start: 1713219562.9886076 Finish: 1713219629.921777 Elapsed Time: 66.9331693649292 PCT Of Run Time: 3 Test zaza.openstack.charm_tests.ceph.tests.CephPrometheusTest: Start: 1713219792.6017141 Finish: 1713219797.773857 Elapsed Time: 5.17214298248291 PCT Of Run Time: 1 Test zaza.openstack.charm_tests.ceph.tests.CephRelationTest: Start: 1713219629.9219327 Finish: 1713219683.6023407 Elapsed Time: 53.680408000946045 PCT Of Run Time: 3 Test zaza.openstack.charm_tests.ceph.tests.CephTest: Start: 1713219683.6024494 Finish: 1713219789.2891512 Elapsed Time: 105.68670177459717 PCT Of Run Time: 5 Test zaza.openstack.charm_tests.ceph.tests.CheckPoolTypes: Start: 1713219552.405795 Finish: 1713219562.9885502 Elapsed Time: 10.582755088806152 PCT Of Run Time: 1 Wait for Deployment: Start: 1713217655.9179013 Finish: 1713219471.630942 Elapsed Time: 1815.7130408287048 PCT Of Run Time: 82 Metadata: {}