Some cinder logs, before error:
2015-03-30 05:24:59.214 25491 DEBUG cinder.openstack.common.lockutils [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] Got semaphore "9e0e2fd1-d69d-4157-a76b-85d75de758a0-delete_volume" for method "lvo_inner2"... inner /usr/lib/python2.7/dist-packages/cinder/openstack/common/lockutils.py:191 2015-03-30 05:24:59.215 25491 DEBUG cinder.openstack.common.lockutils [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] Attempting to grab file lock "9e0e2fd1-d69d-4157-a76b-85d75de758a0-delete_volume" for method "lvo_inner2"... inner /usr/lib/python2.7/dist-packages/cinder/openstack/common/lockutils.py:202 2015-03-30 05:24:59.217 25491 DEBUG cinder.openstack.common.lockutils [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] Got file lock "9e0e2fd1-d69d-4157-a76b-85d75de758a0-delete_volume" at /var/lock/cinder/cinder-9e0e2fd1-d69d-4157-a76b-85d75de758a0-delete_volume for method "lvo_inner2"... inner /usr/lib/python2.7/dist-packages/cinder/openstack/common/lockutils.py:232 2015-03-30 05:24:59.260 25491 INFO cinder.volume.manager [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] volume 9e0e2fd1-d69d-4157-a76b-85d75de758a0: deleting 2015-03-30 05:24:59.261 25491 DEBUG cinder.volume.manager [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] volume 9e0e2fd1-d69d-4157-a76b-85d75de758a0: removing export delete_volume /usr/lib/python2.7/dist-packages/cinder/volume/manager.py:438 2015-03-30 05:24:59.262 25491 DEBUG cinder.volume.manager [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] volume 9e0e2fd1-d69d-4157-a76b-85d75de758a0: deleting delete_volume /usr/lib/python2.7/dist-packages/cinder/volume/manager.py:440 2015-03-30 05:24:59.262 25491 DEBUG cinder.volume.drivers.rbd [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] opening connection to ceph cluster (timeout=-1). _connect_to_rados /usr/lib/python2.7/dist-packages/cinder/volume/drivers/rbd.py:291 2015-03-30 05:24:59.374 25491 DEBUG cinder.volume.drivers.rbd [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] volume has no backup snaps _delete_backup_snaps /usr/lib/python2.7/dist-packages/cinder/volume/drivers/rbd.py:551 2015-03-30 05:24:59.394 25491 DEBUG cinder.volume.drivers.rbd [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] deleting rbd volume volume-9e0e2fd1-d69d-4157-a76b-85d75de758a0 delete_volume /usr/lib/python2.7/dist-packages/cinder/volume/drivers/rbd.py:649 2015-03-30 05:24:59.638 25491 DEBUG cinder.volume.drivers.rbd [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] volume is a clone so cleaning references delete_volume /usr/lib/python2.7/dist-packages/cinder/volume/drivers/rbd.py:671 2015-03-30 05:24:59.703 25491 DEBUG cinder.openstack.common.lockutils [req-f0cb264d-5135-49e0-abd3-ce50d00e0c3e c2b29eac704d4edd8b42a10bcffd89ca 386e7978e270447cb71bb683c9fdfbb9 - - -] Released file lock "9e0e2fd1-d69d-4157-a76b-85d75de758a0-delete_volume" at /var/lock/cinder/cinder-9e0e2fd1-d69d-4157-a76b-85d75de758a0-delete_volume for method "lvo_inner2"... inner /usr/lib/python2.7/dist-packages/cinder/openstack/common/lockutils.py:239
Some cinder logs, before error:
2015-03-30 05:24:59.214 25491 DEBUG cinder. openstack. common. lockutils [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] Got semaphore "9e0e2fd1- d69d-4157- a76b-85d75de758 a0-delete_ volume" for method "lvo_inner2"... inner /usr/lib/ python2. 7/dist- packages/ cinder/ openstack/ common/ lockutils. py:191 openstack. common. lockutils [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] Attempting to grab file lock "9e0e2fd1- d69d-4157- a76b-85d75de758 a0-delete_ volume" for method "lvo_inner2"... inner /usr/lib/ python2. 7/dist- packages/ cinder/ openstack/ common/ lockutils. py:202 openstack. common. lockutils [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] Got file lock "9e0e2fd1- d69d-4157- a76b-85d75de758 a0-delete_ volume" at /var/lock/ cinder/ cinder- 9e0e2fd1- d69d-4157- a76b-85d75de758 a0-delete_ volume for method "lvo_inner2"... inner /usr/lib/ python2. 7/dist- packages/ cinder/ openstack/ common/ lockutils. py:232 volume. manager [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] volume 9e0e2fd1- d69d-4157- a76b-85d75de758 a0: deleting volume. manager [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] volume 9e0e2fd1- d69d-4157- a76b-85d75de758 a0: removing export delete_volume /usr/lib/ python2. 7/dist- packages/ cinder/ volume/ manager. py:438 volume. manager [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] volume 9e0e2fd1- d69d-4157- a76b-85d75de758 a0: deleting delete_volume /usr/lib/ python2. 7/dist- packages/ cinder/ volume/ manager. py:440 volume. drivers. rbd [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] opening connection to ceph cluster (timeout=-1). _connect_to_rados /usr/lib/ python2. 7/dist- packages/ cinder/ volume/ drivers/ rbd.py: 291 volume. drivers. rbd [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] volume has no backup snaps _delete_ backup_ snaps /usr/lib/ python2. 7/dist- packages/ cinder/ volume/ drivers/ rbd.py: 551 volume. drivers. rbd [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] deleting rbd volume volume- 9e0e2fd1- d69d-4157- a76b-85d75de758 a0 delete_volume /usr/lib/ python2. 7/dist- packages/ cinder/ volume/ drivers/ rbd.py: 649 volume. drivers. rbd [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] volume is a clone so cleaning references delete_volume /usr/lib/ python2. 7/dist- packages/ cinder/ volume/ drivers/ rbd.py: 671 openstack. common. lockutils [req-f0cb264d- 5135-49e0- abd3-ce50d00e0c 3e c2b29eac704d4ed d8b42a10bcffd89 ca 386e7978e270447 cb71bb683c9fdfb b9 - - -] Released file lock "9e0e2fd1- d69d-4157- a76b-85d75de758 a0-delete_ volume" at /var/lock/ cinder/ cinder- 9e0e2fd1- d69d-4157- a76b-85d75de758 a0-delete_ volume for method "lvo_inner2"... inner /usr/lib/ python2. 7/dist- packages/ cinder/ openstack/ common/ lockutils. py:239
2015-03-30 05:24:59.215 25491 DEBUG cinder.
2015-03-30 05:24:59.217 25491 DEBUG cinder.
2015-03-30 05:24:59.260 25491 INFO cinder.
2015-03-30 05:24:59.261 25491 DEBUG cinder.
2015-03-30 05:24:59.262 25491 DEBUG cinder.
2015-03-30 05:24:59.262 25491 DEBUG cinder.
2015-03-30 05:24:59.374 25491 DEBUG cinder.
2015-03-30 05:24:59.394 25491 DEBUG cinder.
2015-03-30 05:24:59.638 25491 DEBUG cinder.
2015-03-30 05:24:59.703 25491 DEBUG cinder.