The volume created from PowerVC will NOT be synchronized to OSEE

[Jerry Cai]

This bug is from:
https://jazz04.rchland.ibm.com:9443/jazz/web/projects/SmartCloud OpenStack#action=com.ibm.team.workitem.viewWorkItem&id=187126

# SYSTEM LEVEL

OSEE controller: 9.114.193.41 root/xxxxx
SCE: http://9.114.193.41:18080/cloud/web/login.html admin/xxxxx
PowerVC: 9.114.192.70 root/xxxxx

# DETAILS

1. Create a volume named "test-volume" form PowerVC and "test-volume" becomes "available" ;

2. Service "openstack-cinder-powervc" is running but it does NOT synchronize new created volume from PowerVC to OSEE:

[root@ip9-114-193-41 ˜]# service --status-all |grep powervc
openstack-cinder-powervc (pid 6957) is running...
openstack-glance-powervc (pid 7611) is running...
openstack-neutron-powervc (pid 7650) is running...
openstack-nova-powervc (pid 7714) is running...

[root@ip9-114-193-41 ˜]# cinder list
+--------------------------------------+-----------+--------------+------+----------------------------------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+----------------------------------------+----------+-------------+
| 299562ed-2bee-4861-9620-c1fdff4d90b5 | available | None | 10 | None | false | |
| 54521ad1-96b8-4924-8bfc-6a0b64036592 | error | None | 1 | None | false | |
| 6b201651-84a3-41b1-96d9-baa886aeb87d | available | None | 20 | pvc:c584_n27:Storage_152 base template | false | |
| ccc8cf4a-f7fc-4aff-888c-b6913e7a5bcb | available | None | 50 | None | false | |
+--------------------------------------+-----------+--------------+------+----------------------------------------+----------+----

3. If restart "openstack-cinder-powervc" service, the volume will be synchronized to OSEE but its "Display Name" will be "None":
[root@ip9-114-193-41 ˜]# cinder list
+--------------------------------------+-----------+--------------+------+----------------------------------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+----------------------------------------+----------+-------------+
| 299562ed-2bee-4861-9620-c1fdff4d90b5 | available | None | 10 | None | false | |
| 403d73d9-c529-4d02-b76a-5c8fa5ff9936 | error | None | 1 | None | false | |
| 54521ad1-96b8-4924-8bfc-6a0b64036592 | error | None | 1 | None | false | |
| 6b201651-84a3-41b1-96d9-baa886aeb87d | available | None | 20 | pvc:c584_n27:Storage_152 base template | false | |
| 83678c12-6504-4356-8cb8-a672f069222f | available | test3 | 1 | None | false | |
| ccc8cf4a-f7fc-4aff-888c-b6913e7a5bcb | available | None | 50 | None | false | |
+--------------------------------------+-----------+--------------+------+----------------------------------------+----------+----

# EXPECTED RESULTS

The volume created from PowerVC will be synchronized to OSEE.

# Actual RESULTS

The volume created from PowerVC will NOT be synchronized to OSEE

# SYSTEM & SIGNON INFORMATION
n/a

# AVAILABILITY OF MACHINES
Always

# FREQUENCY OF OCCURRENCE
Always

[Jerry Cai (caimin)]

This should be a defect from cinder.openstack.common.service.py, it should use eventlet's event instead of threading in service.py, here is the method to fix this in incubator(which is parent for nova and cinder component): https://github.com/openstack/oslo-incubator/commit/1e7007824374842bc8108dff5e5e2694e12932b2 . Note that the nova has merged the latest source while cinder doesn't, that's reason why causes the cinder-volume hang there all the time.
I will create a bug to cinder to track this issue, will update number later. This may take a long time to merged into community and ICM, so I'd like to provide a temp fix for this issue, which is using nova's service intead of cinders. Tested that periodically syc does work.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/119004
Committed: https://git.openstack.org/cgit/stackforge/powervc-driver/commit/?id=aef2b5095d69a6d8a33ab20bf12a76d0d3f6a28e
Submitter: Jenkins
Branch: master

commit aef2b5095d69a6d8a33ab20bf12a76d0d3f6a28e
Author: Jerry Cai <email address hidden>
Date: Thu Sep 4 16:57:59 2014 +0800

    Temp fix for powervc side volumes operation not synced to local
    Openstack in cinder-powervc

    Currently cinder service uses threading instead of eventlet's event,
    This causes if you don't monkey patch threading, it will hang there
    all the time. For detail, check this fix in incubator project:
    https://github.com/openstack/oslo-incubator/commit/\
    1e7007824374842bc8108dff5e5e2694e12932b2
    Will create a bug to cinder to fix this. Temporarily fix is to replace
    cinder service instead of nova service in 1365373.

    Change-Id: Ibe770e51563f43495228d84dd6d0284a62bba9e8
    Closes-Bug: #1365373

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: milestone-proposed
Review: https://review.openstack.org/119016

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/119016
Committed: https://git.openstack.org/cgit/stackforge/powervc-driver/commit/?id=5fd4a78833ea6f646b313b69b7ab0999ae805cbf
Submitter: Jenkins
Branch: milestone-proposed

commit 5fd4a78833ea6f646b313b69b7ab0999ae805cbf
Author: Jerry Cai <email address hidden>
Date: Thu Sep 4 16:57:59 2014 +0800

    Temp fix for powervc side volumes operation not synced to local
    Openstack in cinder-powervc

    Currently cinder service uses threading instead of eventlet's event,
    This causes if you don't monkey patch threading, it will hang there
    all the time. For detail, check this fix in incubator project:
    https://github.com/openstack/oslo-incubator/commit/\
    1e7007824374842bc8108dff5e5e2694e12932b2
    Will create a bug to cinder to fix this. Temporarily fix is to replace
    cinder service instead of nova service in 1365373.

    Change-Id: Ibe770e51563f43495228d84dd6d0284a62bba9e8
    Closes-Bug: #1365373
    (cherry picked from commit aef2b5095d69a6d8a33ab20bf12a76d0d3f6a28e)