NOTE: Observed testing via devstack and high concurrency stress testing.
I have observed many instances where cinder snapshots are created, but end up in an orphan / zombie state.
They continue to be listed as part of snapshot-list and count against user quota, but they cannot be deleted, either by the user or the admin.
This generally happens when one user creates the snapshot and a second user issues a delete_snapshot command within a reasonably quick timeframe (max elapsed time observed is 16 seconds between create and delete calls).
Have also noted such snapshots are referenced in the mysql slow log.
NOTE: Observed testing via devstack and high concurrency stress testing.
I have observed many instances where cinder snapshots are created, but end up in an orphan / zombie state.
They continue to be listed as part of snapshot-list and count against user quota, but they cannot be deleted, either by the user or the admin.
This generally happens when one user creates the snapshot and a second user issues a delete_snapshot command within a reasonably quick timeframe (max elapsed time observed is 16 seconds between create and delete calls).
Have also noted such snapshots are referenced in the mysql slow log.
pcrews@ erlking- dev:~/git/ rannsaka$ cinder snapshot-list ------- ------- ------- ------- ----+-- ------- ------- ------- ------- ------- -+----- -----+- ------- ------- ------- ------+ ------+ ------- ------- ------- ------- ----+-- ------- ------- ------- ------- ------- -+----- -----+- ------- ------- ------- ------+ ------+ 9ade-4211- a559-4fe0bcec8a d2 | e7d48279- c499-4efc- 900b-e6867b10e6 ff | creating | snapshot- 0x7f4709178ad0- 73 | 1 | d05d-42fa- 8a70-ce46270f9b d1 | b64918c8- e75b-4fd0- ac54-9b2b2236f4 18 | creating | snapshot- 0x7f4709178ad0- 27 | 99 | 9f44-437b- ac50-f10b2df0b9 cb | f00415bb- aa6d-4f4a- a4eb-8ce43d234d 00 | creating | snapshot- 0x7f470890bc50- 2 | 1 | d5b1-47b2- afad-4360cca516 a0 | cca63364- cad7-4025- 97e0-0b2b388a47 2e | creating | snapshot- 0x7f470890bc50- 70 | 1 | be84-441b- ad7c-1a1e68ba14 ce | d1a5f0cf- b9e7-4458- 9103-9be3e0feba 14 | creating | snapshot- 0x7f470890bc50- 59 | 1 | f997-4b21- 8a24-30ee8b6136 88 | b0cfd1ca- 9d49-4401- b3f2-73aed76003 3e | creating | snapshot- 0x7f4709178e90- 9 | 2 | 733a-4dfe- 8e81-f0e55be38c b7 | a6a683a7- b83c-4705- 8ee8-0207669b27 bf | creating | snapshot- 0x7f470915c410- 78 | 1 | ------- ------- ------- ------- ----+-- ------- ------- ------- ------- ------- -+----- -----+- ------- ------- ------- ------+ ------+ erlking- dev:~/git/ rannsaka$ cinder snapshot-delete 459dc788- 9ade-4211- a559-4fe0bcec8a d2 9ade-4211- a559-4fe0bcec8a d2 failed: Bad Request (HTTP 400) (Request-ID: req-da0daed4- 49ff-49da- 922d-db8c81810e a6)
+------
| ID | Volume ID | Status | Display Name | Size |
+------
| 459dc788-
| 717c38bf-
| 890ad93b-
| 8a722581-
| b286c7ae-
| d378d2ff-
| f14d89cd-
+------
pcrews@
Delete for snapshot 459dc788-
ERROR: Unable to delete any of the specified snapshots.