Comment 2 for bug 1922138

Revision history for this message
Mario Chirinos (mario-chirinos) wrote :

I am attaching the information, the problem seams to see the space ( Insufficient free virtual space (0.0GB) to accommodate thin provisioned 1GB volume on host cinder@cinder-ceph#cinder-ceph.
)
But ceph status shows 123 TiB availables
1. Focal
2. openstack 4.0.0
   openstack-dashboard 18.6.1
   keystone 18.0.0
   nova-cloud-controller 22.0.1
   nova-compute 22.0.1
   nova-mysql-router 8.0.23

3. openstack base #73

4. tail /var/log/cinder/cinder-scheduler.log
2021-04-01 07:04:07.506 207586 INFO cinder.message.api [req-3fbd8c81-77cb-4cf5-acb2-5628380965e9 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] Creating message record for request_id = req-3fbd8c81-77cb-4cf5-acb2-5628380965e9
2021-04-01 07:04:07.551 207586 ERROR cinder.scheduler.flows.create_volume [req-3fbd8c81-77cb-4cf5-acb2-5628380965e9 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available
2021-04-01 07:14:37.396 207586 WARNING py.warnings [req-992bd199-3347-4693-ac8a-d811ecd7fc1c 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] /usr/lib/python3/dist-packages/pymysql/cursors.py:170: Warning: (3719, "'utf8' is currently an alias for the character set UTF8MB3, but will be an alias for UTF8MB4 in a future release. Please consider using UTF8MB4 in order to be unambiguous.")
  result = self._query(query)

2021-04-01 07:14:37.411 207586 WARNING cinder.scheduler.filters.capacity_filter [req-992bd199-3347-4693-ac8a-d811ecd7fc1c 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] Insufficient free virtual space (0.0GB) to accommodate thin provisioned 1GB volume on host cinder@cinder-ceph#cinder-ceph.
2021-04-01 07:14:37.413 207586 INFO cinder.scheduler.base_filter [req-992bd199-3347-4693-ac8a-d811ecd7fc1c 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] Filtering removed all hosts for the request with volume ID 'e0d0a425-97e7-4fda-b865-d3ae493aa983'. Filter results: AvailabilityZoneFilter: (start: 1, end: 1), CapacityFilter: (start: 1, end: 0), CapabilitiesFilter: (start: 0, end: 0)
2021-04-01 07:14:37.413 207586 WARNING cinder.scheduler.filter_scheduler [req-992bd199-3347-4693-ac8a-d811ecd7fc1c 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] No weighed backend found for volume with properties: {'id': 'de03abac-2e8b-4d70-a960-bda031d7b1dc', 'name': '__DEFAULT__', 'description': 'Default Volume Type', 'is_public': True, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2021-02-21T07:11:47.000000', 'updated_at': '2021-02-21T07:11:47.000000', 'deleted_at': None, 'deleted': False}
2021-04-01 07:14:37.413 207586 INFO cinder.message.api [req-992bd199-3347-4693-ac8a-d811ecd7fc1c 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] Creating message record for request_id = req-992bd199-3347-4693-ac8a-d811ecd7fc1c
2021-04-01 07:14:37.463 207586 ERROR cinder.scheduler.flows.create_volume [req-992bd199-3347-4693-ac8a-d811ecd7fc1c 3921d264a0fb4c75a7bd0ebdde1dd5ab a76bc58217ee40349a60e9d658ad80b9 - - -] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available

//-------------------------------------------------

geoint@maas:~$ juju ssh ceph-mon/0 sudo ceph status
  cluster:
    id: 457c2212-7412-11eb-bb51-ffc0149f2d99
    health: HEALTH_ERR
            1 full osd(s)
            18 pool(s) full

  services:
    mon: 3 daemons, quorum juju-191a8d-1-lxd-0,juju-191a8d-0-lxd-0,juju-191a8d-2-lxd-0 (age 5w)
    mgr: juju-191a8d-0-lxd-0(active, since 5w), standbys: juju-191a8d-1-lxd-0, juju-191a8d-2-lxd-0
    osd: 5 osds: 5 up (since 5w), 5 in (since 5w); 51 remapped pgs
    rgw: 1 daemon active (juju-191a8d-0-lxd-1)

  task status:

  data:
    pools: 18 pools, 99 pgs
    objects: 488.92k objects, 1.8 TiB
    usage: 5.3 TiB used, 118 TiB / 123 TiB avail
    pgs: 290276/1466763 objects misplaced (19.790%)
             51 active+clean+remapped
             48 active+clean