cinder-ceph and glance are stuck at waiting - Creating pool 'glance' (replicas=0) - float floor division by zero
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Juju Charmed Operator - MicroCeph |
Fix Released
|
Undecided
|
Hemanth Nakkina | ||
OpenStack Snap |
Fix Released
|
High
|
Hemanth Nakkina |
Bug Description
I haven't taken a deeper look yet but those two units are stuck at waiting.
$ snap list openstack
Name Version Rev Tracking Publisher Notes
openstack 2024.1 503 2024.1/edge canonical✓ -
$ sunbeam cluster bootstrap --role control --role compute --role storage
Use proxy to access external network resources? [y/n] (n):
Management networks shared by hosts (CIDRs, separated by comma) (192.168.123.0/24):
MetalLB address allocation range (supports multiple ranges, comma separated) (192.168.
Disks to attach to MicroCeph (comma separated list) (/dev/sdc): /dev/vdc
⠇ Deploying OpenStack Control Plane to Kubernetes (this may take a while) ... waiting for services to come online (23/25)Timed out while waiting for model 'openstack' to be ready
Error: Timed out while waiting for model 'openstack' to be ready
$ juju status -m openstack | grep waiting
cinder-ceph waiting 1 cinder-ceph-k8s 2024.1/edge 64 10.152.183.178 no installing agent
glance waiting 1 glance-k8s 2024.1/edge 84 10.152.183.75 no installing agent
cinder-ceph/0* waiting idle 10.1.32.209 (workload) Not all relations are ready
glance/0* waiting idle 10.1.32.212 (ceph) integration incomplete
no longer affects: | sunbeam-charms |
Changed in snap-openstack: | |
status: | New → In Progress |
assignee: | nobody → Hemanth Nakkina (hemanth-n) |
importance: | Undecided → High |
Changed in charm-microceph: | |
status: | Fix Committed → Fix Released |
Changed in snap-openstack: | |
status: | Fix Committed → Fix Released |
Looks like the Ceph client side (e.g. glance) is requesting a pool with replicas=0 and it causes "float floor division by zero" on the Ceph cluster side.
unit-microceph-0: 22:05:51 INFO juju.worker. uniter. operation ran "ceph-relation- changed" hook (via hook dispatching script: dispatch) 0.juju- log ceph:3: _on_relation_ changed event 0.juju- log ceph:3: mon cluster in quorum and osds bootstrapped - providing client with keys, processing broker requests 0.juju- log ceph:3: Processing broker req {"api-version": 1, "ops": [{"op": "create-pool", "name": "glance", "replicas": 0, "pg_num": n algorithm" : null, "compression-mode": null, "compression- required- ratio": null, "compression- min-blob- size": null, "compr min-blob- size-hdd" : null, "compression- min-blob- size-ssd" : null, "compression- max-blob- size": null, "compression- max-blob- size-hdd" : null, "compression- max-blob- size-ssd" : nu mode": "pool", "weight": 40}], "request-id": "bf3080dc481472 00ada9e7b6031e3 2a526b4 0.juju- log ceph:3: Processing 1 ceph broker requests 0.juju- log ceph:3: Creating pool 'glance' (replicas=0) 0.juju- log ceph:3: float floor division by zero 0.juju- log ceph:3: Unexpected error occurred while processing requests: {'api-version': 1, 'ops': [{'op': 'create-pool', 'name': 'glance', 'replicas': 0, 'pg_num': None, 'crush-profile': None, 'app-name': 'rbd', 'compression- algorithm' : None, 'compression-mode': None, 'compression- required- ratio': None, 'compression- min-blob- size': None, 'compression- min-blob- size-hdd' : None, 'compression- min-blob- size-ssd' : None, 'compression- max-blob- size': None, 'compression- max-blob- size-hdd' : None, 'compression- max-blob- size-ssd' : None, 'group': None, 'max-bytes': None, 'max-objects': None, 'group-namespace': None, 'rbd-mirroring- mode': 'pool', 'weight': 40}], 'request-id': 'bf3080dc481472 00ada9e7b6031e3 2a526b48cc9' } 0.juju- log ceph:3: {"exit-code": 1, "stderr": "Unexpected error occurred while processing requests: {'api-version': 1, 'ops': [{'op': 'create-pool', 'name': 'glance', 'replicas': 0, 'pg_num': None, 'crush-profile': None, 'app-name': 'rbd', 'compression- algorithm' : None, 'compression-mode': None, 'compression- required- ratio': None, 'compression- min-blob- size': None, 'compression- min-blob- size-hdd' : None, 'compression- min-blob- size-ssd' : None, 'compression- max-blob- size': None, 'compression- max-blob- size-hdd' : None, 'compression- max-blob- size-ssd' : None, 'group': None, 'max-bytes': None, 'max-objects': None, 'group-namespace': None, 'rbd-mirroring- mode': 'pool', 'weight': 40}], 'request-id': 'bf3080dc481472 00ada9e7b6031e3 2a526b48cc9' }"} 0.ceph- relat.. .
unit-microceph-0: 22:06:26 INFO unit.microceph/
unit-microceph-0: 22:06:27 INFO unit.microceph/
unit-microceph-0: 22:06:28 INFO unit.microceph/
ull, "crush-profile": null, "app-name": "rbd", "compression-
ession-
ll, "group": null, "max-bytes": null, "max-objects": null, "group-namespace": null, "rbd-mirroring-
8cc9"}
unit-microceph-0: 22:06:28 INFO unit.microceph/
unit-microceph-0: 22:06:29 INFO unit.microceph/
unit-microceph-0: 22:06:31 ERROR unit.microceph/
unit-microceph-0: 22:06:31 ERROR unit.microceph/
unit-microceph-0: 22:06:31 INFO unit.microceph/
unit-microceph-0: 22:06:32 WARNING unit.microceph/