tempest

  1. Bug #1375136
  2. Comment #1

Comment 1 for bug 1375136

Revision history for this message
Ghanshyam Mann (ghanshyammann) wrote :

Volume hanged in 'deleting' status on cinder side.

Volume - available -

2014-09-29 05:13:07.920 24731 INFO cinder.api.openstack.wsgi [req-47118e54-983a-4bfd-a18b-275386a1f588 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] GET http://127.0.0.1:8776/v1/7a8f399eab3443e09688a46624298b17/volumes/883746cd-2024-4665-a78f-293621e8f548
2014-09-29 05:13:07.920 24731 DEBUG cinder.api.openstack.wsgi [req-47118e54-983a-4bfd-a18b-275386a1f588 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] Empty body provided in request get_body /opt/stack/new/cinder/cinder/api/openstack/wsgi.py:789
2014-09-29 05:13:07.945 24731 INFO cinder.api.v1.volumes [req-47118e54-983a-4bfd-a18b-275386a1f588 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] vol={'migration_status': None, 'availability_zone': u'nova', 'terminated_at': None, 'updated_at': datetime.datetime(2014, 9, 29, 5, 13, 7), 'provider_geometry': None, 'replication_extended_status': None, 'replication_status': u'disabled', 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'883746cd-2024-4665-a78f-293621e8f548', 'size': 1L, 'user_id': u'b8d858f4aebb407b9d648304537d45c0', 'attach_time': None, 'attached_host': None, 'display_description': None, 'volume_admin_metadata': u'[<cinder.db.sqlalchemy.models.VolumeAdminMetadata object at 0x7f2c41d41c10>]', 'project_id': u'7a8f399eab3443e09688a46624298b17', 'launched_at': datetime.datetime(2014, 9, 29, 5, 11, 41), 'scheduled_at': datetime.datetime(2014, 9, 29, 5, 11, 40), 'status': u'available', 'volume_type_id': u'ac268553-305f-414d-b3e5-c3343f0e3d28', 'deleted': False, 'provider_location': u'127.0.0.1:3260,1 iqn.2010-10.org.openstack:volume-883746cd-2024-4665-a78f-293621e8f548 1', 'host': u'devstack-trusty-hpcloud-b4-2451331@lvmdriver-1#lvmdriver-1', 'consistencygroup_id': None, 'source_volid': None, 'provider_auth': u'CHAP 3PmKkHygrnvSv5fMBoPx iGH3z8xmhmfC3cFQEk5o', 'display_name': u'ServerRescueNegativeTestJSON_volume-1818020912', 'instance_uuid': None, 'bootable': False, 'created_at': datetime.datetime(2014, 9, 29, 5, 11, 40), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x7f2c41a62a10>, 'consistencygroup': None, 'volume_metadata': [], '_name_id': None, 'encryption_key_id': None, 'replication_driver_data': None, 'metadata': {u'readonly': u'False'}}
2014-09-29 05:13:08.027 24731 INFO cinder.api.openstack.wsgi [req-47118e54-983a-4bfd-a18b-275386a1f588 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] http://127.0.0.1:8776/v1/7a8f399eab3443e09688a46624298b17/volumes/883746cd-2024-4665-a78f-293621e8f548 returned with HTTP 200
2014-09-29 05:13:08.028 24731 INFO eventlet.wsgi.server [req-47118e54-983a-4bfd-a18b-275386a1f588 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] 127.0.0.1 - - [29/Sep/2014 05:13:08] "GET /v1/7a8f399eab3443e09688a46624298b17/volumes/883746cd-2024-4665-a78f-293621e8f548 HTTP/1.1" 200 825 0.109936
2014-09-29 05:13:08.169 24731 INFO eventlet.wsgi.server [-] (24731) accepted ('127.0.0.1', 42881)

Delete request -

2014-09-29 05:13:08.209 24731 INFO cinder.api.openstack.wsgi [req-b2a12d59-2dee-43f1-89c8-85a3ba582f94 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] DELETE http://127.0.0.1:8776/v1/7a8f399eab3443e09688a46624298b17/volumes/883746cd-2024-4665-a78f-293621e8f548
2014-09-29 05:13:08.209 24731 DEBUG cinder.api.openstack.wsgi [req-b2a12d59-2dee-43f1-89c8-85a3ba582f94 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] Empty body provided in request get_body /opt/stack/new/cinder/cinder/api/openstack/wsgi.py:789
2014-09-29 05:13:08.209 24731 INFO cinder.api.v1.volumes [req-b2a12d59-2dee-43f1-89c8-85a3ba582f94 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] Delete volume with id: 883746cd-2024-4665-a78f-293621e8f548
2014-09-29 05:13:08.265 24731 INFO cinder.api.openstack.wsgi [req-b2a12d59-2dee-43f1-89c8-85a3ba582f94 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] http://127.0.0.1:8776/v1/7a8f399eab3443e09688a46624298b17/volumes/883746cd-2024-4665-a78f-293621e8f548 returned with HTTP 202
2014-09-29 05:13:08.266 24731 INFO eventlet.wsgi.server [req-b2a12d59-2dee-43f1-89c8-85a3ba582f94 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] 127.0.0.1 - - [29/Sep/2014 05:13:08] "DELETE /v1/7a8f399eab3443e09688a46624298b17/volumes/883746cd-2024-4665-a78f-293621e8f548 HTTP/1.1" 202 187 0.095936
2014-09-29 05:13:08.277 24730 INFO eventlet.wsgi.server [-] (24730) accepted ('127.0.0.1', 42884)
2014-09-29 05:13:08.280 24730 INFO cinder.api.openstack.wsgi [req-9d15c3d2-a905-4e83-a72b-8ea69950b484 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] GET http://127.0.0.1:8776/v1/7a8f399eab3443e09688a46624298b17/volumes/883746cd-2024-4665-a78f-293621e8f548
2014-09-29 05:13:08.281 24730 DEBUG cinder.api.openstack.wsgi [req-9d15c3d2-a905-4e83-a72b-8ea69950b484 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] Empty body provided in request get_body /opt/stack/new/cinder/cinder/api/openstack/wsgi.py:789
2014-09-29 05:13:08.315 24730 INFO cinder.api.v1.volumes [req-9d15c3d2-a905-4e83-a72b-8ea69950b484 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] vol={'migration_status': None, 'availability_zone': u'nova', 'terminated_at': datetime.datetime(2014, 9, 29, 5, 13, 8), 'updated_at': datetime.datetime(2014, 9, 29, 5, 13, 8), 'provider_geometry': None, 'replication_extended_status': None, 'replication_status': u'disabled', 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'883746cd-2024-4665-a78f-293621e8f548', 'size': 1L, 'user_id': u'b8d858f4aebb407b9d648304537d45c0', 'attach_time': None, 'attached_host': None, 'display_description': None, 'volume_admin_metadata': u'[<cinder.db.sqlalchemy.models.VolumeAdminMetadata object at 0x7f2c41bba410>]', 'project_id': u'7a8f399eab3443e09688a46624298b17', 'launched_at': datetime.datetime(2014, 9, 29, 5, 11, 41), 'scheduled_at': datetime.datetime(2014, 9, 29, 5, 11, 40), 'status': u'deleting', 'volume_type_id': u'ac268553-305f-414d-b3e5-c3343f0e3d28', 'deleted': False, 'provider_location': u'127.0.0.1:3260,1 iqn.2010-10.org.openstack:volume-883746cd-2024-4665-a78f-293621e8f548 1', 'host': u'devstack-trusty-hpcloud-b4-2451331@lvmdriver-1#lvmdriver-1', 'consistencygroup_id': None, 'source_volid': None, 'provider_auth': u'CHAP 3PmKkHygrnvSv5fMBoPx iGH3z8xmhmfC3cFQEk5o', 'display_name': u'ServerRescueNegativeTestJSON_volume-1818020912', 'instance_uuid': None, 'bootable': False, 'created_at': datetime.datetime(2014, 9, 29, 5, 11, 40), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x7f2c41b3dd50>, 'consistencygroup': None, 'volume_metadata': [], '_name_id': None, 'encryption_key_id': None, 'replication_driver_data': None, 'metadata': {u'readonly': u'False'}}

Still in 'deleting' status-

2014-09-29 05:16:23.979 24729 INFO cinder.api.v1.volumes [req-728c042c-ad4b-4c9f-90b5-c92b3ac06fc6 b8d858f4aebb407b9d648304537d45c0 7a8f399eab3443e09688a46624298b17 - - -] vol={'migration_status': None, 'availability_zone': u'nova', 'terminated_at': datetime.datetime(2014, 9, 29, 5, 13, 8), 'updated_at': datetime.datetime(2014, 9, 29, 5, 13, 8), 'provider_geometry': None, 'replication_extended_status': None, 'replication_status': u'disabled', 'snapshot_id': None, 'ec2_id': None, 'mountpoint': None, 'deleted_at': None, 'id': u'883746cd-2024-4665-a78f-293621e8f548', 'size': 1L, 'user_id': u'b8d858f4aebb407b9d648304537d45c0', 'attach_time': None, 'attached_host': None, 'display_description': None, 'volume_admin_metadata': u'[<cinder.db.sqlalchemy.models.VolumeAdminMetadata object at 0x7f2c41b95d90>]', 'project_id': u'7a8f399eab3443e09688a46624298b17', 'launched_at': datetime.datetime(2014, 9, 29, 5, 11, 41), 'scheduled_at': datetime.datetime(2014, 9, 29, 5, 11, 40), 'status': u'deleting', 'volume_type_id': u'ac268553-305f-414d-b3e5-c3343f0e3d28', 'deleted': False, 'provider_location': u'127.0.0.1:3260,1 iqn.2010-10.org.openstack:volume-883746cd-2024-4665-a78f-293621e8f548 1', 'host': u'devstack-trusty-hpcloud-b4-2451331@lvmdriver-1#lvmdriver-1', 'consistencygroup_id': None, 'source_volid': None, 'provider_auth': u'CHAP 3PmKkHygrnvSv5fMBoPx iGH3z8xmhmfC3cFQEk5o', 'display_name': u'ServerRescueNegativeTestJSON_volume-1818020912', 'instance_uuid': None, 'bootable': False, 'created_at': datetime.datetime(2014, 9, 29, 5, 11, 40), 'attach_status': u'detached', 'volume_type': <cinder.db.sqlalchemy.models.VolumeTypes object at 0x7f2c4a249b10>, 'consistencygroup': None, 'volume_metadata': [], '_name_id': None, 'encryption_key_id': None, 'replication_driver_data': None, 'metadata': {u'readonly': u'False'}}