Occasionally, the cg and cgsnapshot may not deleted in VNX driver

Bug #1499615 reported by Tina Tang
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Cinder
Fix Released
Medium
Peter Wang

Bug Description

We encountered the issue that the CG and CGsnapshot is deleted successfully however the CG and CGsnapshot may still exist on the VNX system. It is because the VNX driver didn't poll the VNX system to get the latest information. Thus the driver didn't see the new created CG and CGsnapshot which is created in a short time..

For example we may see below warnings in the log:
 /opt/stack/logs/screen/screen-c-vol.log:2015-09-16 05:39:20.320 WARNING cinder.volume.drivers.emc.emc_vnx_cli [req-116ffea8-e2b2-4e7c-a470-bd21244f8f5c ctx_rally_41d55ef2-f774-4eae-8b11-d539dd3db35c_tenant_0] CG 5e527e77-7e60-472d-81d4-274ce5d40665 does not exist. Message: Cannot find the consistency group. \n\n

However, in fact, the CG exists on the VNX
stack@ubuntu-server5:~/.rally/test$ /opt/Navisphere/bin/naviseccli -address 192.168.1.52 -user sysadmin -password sysadmin -scope global snap -group -list -id 5e527e77-7e60-472d-81d4-274ce5d40665 | grep Name

Name: 5e527e77-7e60-472d-81d4-274ce5d40665

Tina Tang (tina-tang)
Changed in cinder:
assignee: nobody → Tina Tang (tina-tang)
Xing Yang (xing-yang)
Changed in cinder:
status: New → Triaged
Peter Wang (peter.wang)
Changed in cinder:
assignee: Tina Tang (tina-tang) → nobody
assignee: nobody → EMC VNX OpenStack (emc-vnx-openstack)
Peter Wang (peter.wang)
Changed in cinder:
status: Triaged → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (master)

Fix proposed to branch: master
Review: https://review.openstack.org/255655

Changed in cinder:
assignee: EMC VNX OpenStack (emc-vnx-openstack) → Peter Wang (peter.wang)
status: Confirmed → In Progress
Xing Yang (xing-yang)
Changed in cinder:
milestone: none → mitaka-2
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (master)

Reviewed: https://review.openstack.org/255655
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=f7b5655d188bfde96333760bbe634f45d4a16395
Submitter: Jenkins
Branch: master

commit f7b5655d188bfde96333760bbe634f45d4a16395
Author: peter_wang <email address hidden>
Date: Tue Dec 8 03:18:31 2015 -0500

    VNX: Fix issue in deleting cg/cgsnapshot

    If user deletes a cg/cgsnapshot quickly after its creation,
    driver would report 'not found' warning, and return success
    for the deletion, but actually, the object underlying the VNX
    is not deleted.

    This fix tries to wait the cg and cg snapshot to be available
    to make sure it's eligible for deletion.

    liberty-backport-potential
    Closes-Bug: 1499615
    Change-Id: Ifae57b9e95e01b1789a37ac7c03e9aad65cd50f7

Changed in cinder:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to cinder (stable/liberty)

Fix proposed to branch: stable/liberty
Review: https://review.openstack.org/256262

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to cinder (stable/liberty)

Reviewed: https://review.openstack.org/256262
Committed: https://git.openstack.org/cgit/openstack/cinder/commit/?id=07e8c6728b5543dcec80ffad0c18972a7a6d2223
Submitter: Jenkins
Branch: stable/liberty

commit 07e8c6728b5543dcec80ffad0c18972a7a6d2223
Author: peter_wang <email address hidden>
Date: Tue Dec 8 03:18:31 2015 -0500

    VNX: Fix issue in deleting cg/cgsnapshot

    If user deletes a cg/cgsnapshot quickly after its creation,
    driver would report 'not found' warning, and return success
    for the deletion, but actually, the object underlying the VNX
    is not deleted.

    This fix tries to wait the cg and cg snapshot to be available
    to make sure it's eligible for deletion.

    liberty-backport-potential
    Closes-Bug: 1499615
    (cherry picked from commit f7b5655d188bfde96333760bbe634f45d4a16395)

    Change-Id: Ifae57b9e95e01b1789a37ac7c03e9aad65cd50f7

tags: added: in-stable-liberty
Revision history for this message
Thierry Carrez (ttx) wrote : Fix included in cinder 7.0.1

This issue was fixed in the cinder 7.0.1 release (liberty).

Revision history for this message
Thierry Carrez (ttx) wrote : Fix included in openstack/cinder 8.0.0.0b2

This issue was fixed in the openstack/cinder 8.0.0.0b2 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.