| 2016-10-11 13:34:39 |
Serg Lystopad |
bug |
|
|
added bug |
| 2016-10-11 13:37:10 |
Serg Lystopad |
description |
Detailed bug description:
Both Cinder and Glance use NFS as backend. For such scenarious Cinder supports 'NetApp NFS Copy Offload client'(http://docs.openstack.org/juno/config-reference/content/ontap-cluster-nfs.html) to copy images from Glance to Cinder using NFS (unlike regular HTTP downloading from Glance API).
The issue is when offloading tool is configured Cinder downloads image from Glance via HTTP before using offloading tool. So effectively it does the job twice: first it downloads image from Glance using HTTP (converts it ....) and then it downloads image second time using offloading tool.
Steps to reproduce:
Configure NetApp NFS backend for Cinder, specify 2 (or more) NFS shares for NFS backend.
Configure NFS backend for Glance (file backend pointing to NFS mount point).
Create volume `cinder create --image 59cd2153-f892-41e0-b8fa-3bd9cdde16af 40`
Check cinder-volume log:
2016-10-11 11:26:41.819 17653 DEBUG glanceclient.common.http [req-f987f983-ee2e-4886-9f35-945ee9f554b9 8555d82365964315840708d6efdafeae 0ff102a3698842fa89dacf049cf84e40
- - -] curl -g -i -X GET -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'User-Agent: python-glanceclient' -H 'Connection: keep-alive' -H 'X-Auth-Token: {SHA1}52
5561ab8f9c94662aced0187f7b58ce29dc0fa5' -H 'Content-Type: application/octet-stream' http://172.18.54.101:9292/v2/images/59cd2153-f892-41e0-b8fa-3bd9cdde16af/file log_cur
l_request /usr/lib/python2.7/dist-packages/glanceclient/common/http.py:185
2016-10-11 11:26:41.931 17653 DEBUG glanceclient.common.http [req-f987f983-ee2e-4886-9f35-945ee9f554b9 8555d82365964315840708d6efdafeae 0ff102a3698842fa89dacf049cf84e40
- - -]
HTTP/1.1 200 OK
content-length: 8823242752
content-md5: e7f6e7d7d38423a705394ad72fdb823c
connection: close
date: Tue, 11 Oct 2016 11:26:41 GMT
content-type: application/octet-stream
x-openstack-request-id: req-1fe0c5cb-1467-4fb8-bfc7-ee91e278a252
log_http_response /usr/lib/python2.7/dist-packages/glanceclient/common/http.py:199
...
2016-10-11 11:28:32.317 17653 DEBUG cinder.image.image_utils [req-f987f983-ee2e-4886-9f35-945ee9f554b9 8555d82365964315840708d6efdafeae 0ff102a3698842fa89dacf049cf84e40 - - -] Image fetch details: dest /var/lib/cinder/conversion/tmpUgLYML, size 8414.00 MB, duration 110.50 sec fetch /usr/lib/python2.7/dist-packages/cinder/image/image_utils.py:177
and later
2016-10-11 11:28:32.872 17653 DEBUG cinder.volume.flows.manager.create_volume [req-c4980bb2-c286-4739-b0bc-9b87770e225f - - - - -] Attempting download of 59cd2153-f892-41e0-b8fa-3bd9cdde16af ((u'file:///mnt/glance/images/59cd2153-f892-41e0-b8fa-3bd9cdde16af', [{u'url': u'file:///mnt/glance/images/59cd2153-f892-41e0-b8fa-3bd9cdde16af', u'metadata': {u'mountpoint': u'/mnt/glance/images', u'type': u'nfs', u'id': u'NetAppNFS', u'share_location': u'nfs://172.18.52.240/vol_glance/images'}}])) to volume 915ec5e6-73f8-44c5-975c-b5bb4652db96. _copy_image_to_volume /usr/lib/python2.7/dist-packages/cinder/volume/flows/manager/create_volume.py:517
2016-10-11 11:28:32.875 17653 DEBUG cinder.volume.drivers.netapp.dataontap.nfs_cmode [req-c4980bb2-c286-4739-b0bc-9b87770e225f - - - - -] No result found in image cache copy_image_to_volume /usr/lib/python2.7/dist-packages/cinder/volume/drivers/netapp/dataontap/nfs_cmode.py:426
2016-10-11 11:28:32.875 17653 DEBUG cinder.volume.drivers.netapp.dataontap.nfs_cmode [req-c4980bb2-c286-4739-b0bc-9b87770e225f - - - - -] Trying copy from image service using copy offload. _copy_from_img_service /usr/lib/python2.7/dist-packages/cinder/volume/drivers/netapp/dataontap/nfs_cmode.py:502
Expected results:
Cinder downloads image with ID 59cd2153-f892-41e0-b8fa-3bd9cdde16af dirrectly (via NFS using offloading tool)
Actual result:
Although 'offloading tool' is configured for Cinder and Glance backend is NFS, Cinder downloads image from Glance using HTTP client before using 'offloading tool' (so actually it does the job twice)
Description of the environment
VERSION:
feature_groups:
- mirantis
production: "docker"
release: "8.0"
api: "1.0"
build_number: "570"
build_id: "570"
fuel-nailgun_sha: "558ca91a854cf29e395940c232911ffb851899c1"
python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5"
fuel-agent_sha: "658be72c4b42d3e1436b86ac4567ab914bfb451b"
fuel-nailgun-agent_sha: "b2bb466fd5bd92da614cdbd819d6999c510ebfb1"
astute_sha: "b81577a5b7857c4be8748492bae1dec2fa89b446"
fuel-library_sha: "c2a335b5b725f1b994f78d4c78723d29fa44685a"
fuel-ostf_sha: "3bc76a63a9e7d195ff34eadc29552f4235fa6c52"
fuel-mirror_sha: "fb45b80d7bee5899d931f926e5c9512e2b442749"
fuelmenu_sha: "78ffc73065a9674b707c081d128cb7eea611474f"
shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906"
network-checker_sha: "a43cf96cd9532f10794dce736350bf5bed350e9d"
fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
fuelmain_sha: "d605bcbabf315382d56d0ce8143458be67c53434" |
Detailed bug description:
Both Cinder and Glance use NFS as backend. For such scenarios Cinder supports 'NetApp NFS Copy Offload client'(http://docs.openstack.org/juno/config-reference/content/ontap-cluster-nfs.html) to copy images from Glance to Cinder using NFS (unlike regular HTTP downloading from Glance API).
The issue is when offloading tool is configured Cinder downloads image from Glance via HTTP before using offloading tool. So effectively it does the job twice: first it downloads image from Glance using HTTP (converts it ....) and then it downloads image second time using offloading tool.
Steps to reproduce:
Configure NetApp NFS backend for Cinder, specify 2 (or more) NFS shares for NFS backend.
Configure NFS backend for Glance (file backend pointing to NFS mount point).
Create volume `cinder create --image 59cd2153-f892-41e0-b8fa-3bd9cdde16af 40`
Check cinder-volume log:
2016-10-11 11:26:41.819 17653 DEBUG glanceclient.common.http [req-f987f983-ee2e-4886-9f35-945ee9f554b9 8555d82365964315840708d6efdafeae 0ff102a3698842fa89dacf049cf84e40
- - -] curl -g -i -X GET -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'User-Agent: python-glanceclient' -H 'Connection: keep-alive' -H 'X-Auth-Token: {SHA1}52
5561ab8f9c94662aced0187f7b58ce29dc0fa5' -H 'Content-Type: application/octet-stream' http://172.18.54.101:9292/v2/images/59cd2153-f892-41e0-b8fa-3bd9cdde16af/file log_cur
l_request /usr/lib/python2.7/dist-packages/glanceclient/common/http.py:185
2016-10-11 11:26:41.931 17653 DEBUG glanceclient.common.http [req-f987f983-ee2e-4886-9f35-945ee9f554b9 8555d82365964315840708d6efdafeae 0ff102a3698842fa89dacf049cf84e40
- - -]
HTTP/1.1 200 OK
content-length: 8823242752
content-md5: e7f6e7d7d38423a705394ad72fdb823c
connection: close
date: Tue, 11 Oct 2016 11:26:41 GMT
content-type: application/octet-stream
x-openstack-request-id: req-1fe0c5cb-1467-4fb8-bfc7-ee91e278a252
log_http_response /usr/lib/python2.7/dist-packages/glanceclient/common/http.py:199
...
2016-10-11 11:28:32.317 17653 DEBUG cinder.image.image_utils [req-f987f983-ee2e-4886-9f35-945ee9f554b9 8555d82365964315840708d6efdafeae 0ff102a3698842fa89dacf049cf84e40 - - -] Image fetch details: dest /var/lib/cinder/conversion/tmpUgLYML, size 8414.00 MB, duration 110.50 sec fetch /usr/lib/python2.7/dist-packages/cinder/image/image_utils.py:177
and later
2016-10-11 11:28:32.872 17653 DEBUG cinder.volume.flows.manager.create_volume [req-c4980bb2-c286-4739-b0bc-9b87770e225f - - - - -] Attempting download of 59cd2153-f892-41e0-b8fa-3bd9cdde16af ((u'file:///mnt/glance/images/59cd2153-f892-41e0-b8fa-3bd9cdde16af', [{u'url': u'file:///mnt/glance/images/59cd2153-f892-41e0-b8fa-3bd9cdde16af', u'metadata': {u'mountpoint': u'/mnt/glance/images', u'type': u'nfs', u'id': u'NetAppNFS', u'share_location': u'nfs://172.18.52.240/vol_glance/images'}}])) to volume 915ec5e6-73f8-44c5-975c-b5bb4652db96. _copy_image_to_volume /usr/lib/python2.7/dist-packages/cinder/volume/flows/manager/create_volume.py:517
2016-10-11 11:28:32.875 17653 DEBUG cinder.volume.drivers.netapp.dataontap.nfs_cmode [req-c4980bb2-c286-4739-b0bc-9b87770e225f - - - - -] No result found in image cache copy_image_to_volume /usr/lib/python2.7/dist-packages/cinder/volume/drivers/netapp/dataontap/nfs_cmode.py:426
2016-10-11 11:28:32.875 17653 DEBUG cinder.volume.drivers.netapp.dataontap.nfs_cmode [req-c4980bb2-c286-4739-b0bc-9b87770e225f - - - - -] Trying copy from image service using copy offload. _copy_from_img_service /usr/lib/python2.7/dist-packages/cinder/volume/drivers/netapp/dataontap/nfs_cmode.py:502
Example log file https://drive.google.com/open?id=0BzqvkqZNKRGdYWQ1eVhFNkpObGs
Expected results:
Cinder downloads image with ID 59cd2153-f892-41e0-b8fa-3bd9cdde16af dirrectly (via NFS using offloading tool)
Actual result:
Although 'offloading tool' is configured for Cinder and Glance backend is NFS, Cinder downloads image from Glance using HTTP client before using 'offloading tool' (so actually it does the job twice)
Description of the environment
VERSION:
feature_groups:
- mirantis
production: "docker"
release: "8.0"
api: "1.0"
build_number: "570"
build_id: "570"
fuel-nailgun_sha: "558ca91a854cf29e395940c232911ffb851899c1"
python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5"
fuel-agent_sha: "658be72c4b42d3e1436b86ac4567ab914bfb451b"
fuel-nailgun-agent_sha: "b2bb466fd5bd92da614cdbd819d6999c510ebfb1"
astute_sha: "b81577a5b7857c4be8748492bae1dec2fa89b446"
fuel-library_sha: "c2a335b5b725f1b994f78d4c78723d29fa44685a"
fuel-ostf_sha: "3bc76a63a9e7d195ff34eadc29552f4235fa6c52"
fuel-mirror_sha: "fb45b80d7bee5899d931f926e5c9512e2b442749"
fuelmenu_sha: "78ffc73065a9674b707c081d128cb7eea611474f"
shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906"
network-checker_sha: "a43cf96cd9532f10794dce736350bf5bed350e9d"
fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
fuelmain_sha: "d605bcbabf315382d56d0ce8143458be67c53434" |
|
| 2016-10-11 13:40:10 |
Ivan Kolodyazhny |
mos: assignee |
|
Ivan Kolodyazhny (e0ne) |
|
| 2016-10-11 21:10:38 |
Goutham Pacha Ravi |
bug |
|
|
added subscriber NetApp |
| 2016-10-11 21:16:49 |
Ivan Kolodyazhny |
mos: milestone |
|
8.0-mu-4 |
|
| 2016-10-11 21:17:03 |
Ivan Kolodyazhny |
nominated for series |
|
mos/10.0.x |
|
| 2016-10-11 21:17:03 |
Ivan Kolodyazhny |
bug task added |
|
mos/10.0.x |
|
| 2016-10-11 21:17:03 |
Ivan Kolodyazhny |
nominated for series |
|
mos/8.0.x |
|
| 2016-10-11 21:17:03 |
Ivan Kolodyazhny |
bug task added |
|
mos/8.0.x |
|
| 2016-10-11 21:17:03 |
Ivan Kolodyazhny |
nominated for series |
|
mos/9.x |
|
| 2016-10-11 21:17:03 |
Ivan Kolodyazhny |
bug task added |
|
mos/9.x |
|
| 2016-10-11 21:17:12 |
Ivan Kolodyazhny |
mos/9.x: milestone |
8.0-mu-4 |
|
|
| 2016-10-11 21:17:18 |
Ivan Kolodyazhny |
mos/8.0.x: status |
New |
Confirmed |
|
| 2016-10-12 13:08:52 |
Vitaly Sedelnik |
tags |
customer-found |
area-cinder customer-found |
|
| 2016-10-12 13:08:57 |
Vitaly Sedelnik |
mos/10.0.x: status |
New |
Confirmed |
|
| 2016-10-12 13:09:00 |
Vitaly Sedelnik |
mos/9.x: status |
New |
Confirmed |
|
| 2016-10-12 13:09:16 |
Vitaly Sedelnik |
mos/8.0.x: assignee |
|
MOS Cinder (mos-cinder) |
|
| 2016-10-12 13:09:22 |
Vitaly Sedelnik |
mos/10.0.x: assignee |
|
MOS Cinder (mos-cinder) |
|
| 2016-10-12 13:09:29 |
Vitaly Sedelnik |
mos/10.0.x: importance |
Undecided |
Medium |
|
| 2016-10-12 13:09:32 |
Vitaly Sedelnik |
mos/8.0.x: importance |
Undecided |
Medium |
|
| 2016-10-12 13:09:34 |
Vitaly Sedelnik |
mos/9.x: importance |
Undecided |
Medium |
|
| 2016-10-12 13:09:37 |
Vitaly Sedelnik |
mos/9.x: milestone |
|
9.2 |
|
| 2016-10-12 13:09:41 |
Vitaly Sedelnik |
mos/8.0.x: milestone |
|
8.0-updates |
|
| 2016-10-12 13:09:46 |
Vitaly Sedelnik |
mos/10.0.x: milestone |
|
10.0 |
|
| 2016-11-02 09:40:52 |
Bishoy |
bug |
|
|
added subscriber Bishoy |
| 2016-11-30 21:01:04 |
Goutham Pacha Ravi |
bug task added |
|
cinder |
|
| 2016-11-30 21:01:15 |
Goutham Pacha Ravi |
cinder: assignee |
|
Goutham Pacha Ravi (gouthamr) |
|
| 2016-12-01 07:32:11 |
Bishoy |
cinder: status |
New |
Confirmed |
|
| 2016-12-02 10:44:51 |
Goutham Pacha Ravi |
summary |
[netapp] Cinder downloads image from Glance twice |
Cinder downloads image from Glance twice |
|
| 2016-12-02 10:45:04 |
Goutham Pacha Ravi |
tags |
area-cinder customer-found |
area-cinder customer-found netapp |
|
| 2016-12-04 08:33:51 |
Serg Lystopad |
tags |
area-cinder customer-found netapp |
area-cinder ct1 customer-found netapp |
|
| 2017-01-04 16:40:35 |
Ivan Kolodyazhny |
summary |
Cinder downloads image from Glance twice |
[NetApp NFS] Cinder downloads image from Glance twice |
|
| 2017-01-30 16:27:56 |
Ivan Kolodyazhny |
mos/9.x: milestone |
9.2 |
9.x-updates |
|
| 2017-02-01 12:01:15 |
Vitaly Sedelnik |
mos/9.x: milestone |
9.x-updates |
9.2-mu-1 |
|
| 2017-02-17 15:17:09 |
Ivan Kolodyazhny |
mos/9.x: status |
Confirmed |
Won't Fix |
|
| 2017-02-17 15:17:16 |
Ivan Kolodyazhny |
mos/10.0.x: status |
Confirmed |
Won't Fix |
|
| 2017-02-17 15:17:22 |
Ivan Kolodyazhny |
mos/8.0.x: status |
Confirmed |
Won't Fix |
|
| 2017-03-02 15:24:49 |
Ivan Kolodyazhny |
mos: status |
Confirmed |
Won't Fix |
|
| 2017-03-07 12:19:58 |
Denis Meltsaykin |
bug task deleted |
mos/9.x |
|
|
| 2017-03-07 12:20:05 |
Denis Meltsaykin |
mos: milestone |
9.2-mu-1 |
9.x-updates |
|
| 2017-03-30 11:48:53 |
Kan Itani |
bug |
|
|
added subscriber Kan Itani |
| 2017-09-26 22:47:34 |
Sean McGinnis |
cinder: assignee |
Goutham Pacha Ravi (gouthamr) |
|
|
| 2017-12-13 19:17:18 |
OpenStack Infra |
cinder: status |
Confirmed |
In Progress |
|
| 2017-12-13 19:17:18 |
OpenStack Infra |
cinder: assignee |
|
Adriano (rosso-af) |
|
| 2017-12-14 14:37:52 |
OpenStack Infra |
cinder: assignee |
Adriano (rosso-af) |
Goutham Pacha Ravi (gouthamr) |
|
| 2017-12-15 19:17:09 |
OpenStack Infra |
cinder: status |
In Progress |
Fix Released |
|
| 2018-02-20 01:52:19 |
OpenStack Infra |
tags |
area-cinder ct1 customer-found netapp |
area-cinder ct1 customer-found in-stable-pike netapp |
|
| 2018-02-20 01:52:30 |
OpenStack Infra |
tags |
area-cinder ct1 customer-found in-stable-pike netapp |
area-cinder ct1 customer-found in-driverfixes-ocata in-stable-pike netapp |
|
| 2018-02-20 15:13:58 |
OpenStack Infra |
tags |
area-cinder ct1 customer-found in-driverfixes-ocata in-stable-pike netapp |
area-cinder ct1 customer-found in-driverfixes-newton in-driverfixes-ocata in-stable-pike netapp |
|
| 2018-05-16 06:56:06 |
OpenStack Infra |
tags |
area-cinder ct1 customer-found in-driverfixes-newton in-driverfixes-ocata in-stable-pike netapp |
area-cinder ct1 customer-found in-driverfixes-newton in-driverfixes-ocata in-stable-ocata in-stable-pike netapp |
|
