glance image-show does not output correctly

Bug #1487645 reported by Colleen Murphy
36
This bug affects 8 people
Affects Status Importance Assigned to Milestone
Glance Client
Fix Released
Critical
David Sariel
python-glanceclient (Ubuntu)
Fix Released
High
James Page
python-urllib3 (Ubuntu)
Invalid
High
Unassigned
requests (Ubuntu)
Invalid
High
Unassigned

Bug Description

1) Description of the problem

When running `glance image-show` on an existing image, the glance client does not output the details of the image.

glance client version: 0.19.0

operating system: ubuntu 14.04

The glance client is installed from the UCA liberty-staging repo. This bug does not appear when python-glanceclient is installed from the CentOS 7 delorean repo or when installed directly from pip.

2) Impact

A user can't view details of their image via the command line.

The behavior trickles down to python-openstackclient.

Our use case is in puppet: the glance_image provider in the glance puppet module cannot fetch details of an uploaded image, and so tries to upload the image again with --copy-from and fails.

3) Expected behavior

(Installed from UCA Kilo)

# glance --version
0.15.0
# glance image-show 3aa89a60-a18f-4c5e-bda1-a60eed5f6997
+------------------+--------------------------------------+
| Property | Value |
+------------------+--------------------------------------+
| checksum | d972013792949d0d3ba628fbe8685bce |
| container_format | bare |
| created_at | 2015-08-21T21:22:57.000000 |
| deleted | False |
| disk_format | qcow2 |
| id | 3aa89a60-a18f-4c5e-bda1-a60eed5f6997 |
| is_public | True |
| min_disk | 0 |
| min_ram | 0 |
| name | test_image |
| owner | fe3360a176d54a049883f9914552798d |
| protected | False |
| size | 13147648 |
| status | active |
| updated_at | 2015-08-21T21:23:00.000000 |
+------------------+--------------------------------------+

4) Actual behavior

(Installed from UCA Liberty-staging)

# glance --version
0.19.0
# glance image-show 728d718c-22cd-4c59-a25d-58ec163d7c69
id

5) Steps to reproduce

 - install the liberty-staging repo
 - apt-get install python-glanceclient
 - run glance image-show against an openstack cloud with glance exposed

Additional information:

# lsb_release -rd
Description: Ubuntu 14.04.2 LTS
Release: 14.04
# apt-cache policy python-glanceclient
python-glanceclient:
  Installed: 1:0.19.0-1ubuntu1~cloud0
  Candidate: 1:0.19.0-1ubuntu1~cloud0
  Version table:
 *** 1:0.19.0-1ubuntu1~cloud0 0
        500 http://ppa.launchpad.net/ubuntu-cloud-archive/liberty-staging/ubuntu/ trusty/main amd64 Packages
        100 /var/lib/dpkg/status
     1:0.12.0-0ubuntu1 0
        500 http://archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages

Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in python-glanceclient (Ubuntu):
status: New → Confirmed
Revision history for this message
Ed Balduf (ebalduf) wrote :

I'm getting this too, on a fresh devstack pull from head on Friday 8/21 onto Fedora 21.

[e@devstack devstack]$ glance image-list
+--------------------------------------+---------------------------------+-------------+------------------+----------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+---------------------------------+-------------+------------------+----------+--------+
| e20fae04-35b1-42f4-9025-2712be7396e0 | cirros-0.3.2-x86_64-disk | qcow2 | bare | 13167616 | active |
| 66e788d6-ee11-492a-ba7b-3d3e1ff70cbe | cirros-0.3.2-x86_64-uec | ami | ami | 25165824 | active |
| 51b75631-d165-4f5f-b869-997a25ecc211 | cirros-0.3.2-x86_64-uec-kernel | aki | aki | 4969360 | active |
| c6ecd6bc-031c-4129-8de4-c8c0c9263bf6 | cirros-0.3.2-x86_64-uec-ramdisk | ari | ari | 3723817 | active |
+--------------------------------------+---------------------------------+-------------+------------------+----------+--------+
[e@devstack devstack]$ glance image-show e20fae04-35b1-42f4-9025-2712be7396e0
id
[e@devstack devstack]$ glance --version
0.19.0
[e@devstack devstack]$ cat /etc/fedora-release
Fedora release 21 (Twenty One)
[e@devstack devstack]$ uname -a
Linux devstack.p.solidfire.net 4.0.4-202.fc21.x86_64 #1 SMP Wed May 27 22:28:42 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

Revision history for this message
Colleen Murphy (krinkle) wrote :

Moving this to the python-glanceclient project instead of the Ubuntu package since this appears to be a cross-distro problem.

affects: python-glanceclient (Ubuntu) → python-glanceclient
Revision history for this message
Ed Balduf (ebalduf) wrote :
Download full text (3.6 KiB)

A bit more detail here to help. Here is the output from glanceclient with debug and verbose. Taking a look at the trace and the code in master they were radically different, so it seems like this is a version problem. See below

[e@devstack glanceclient]$ glance -d -v image-show e20fae04-35b1-42f4-9025-2712be7396e0
curl -g -i -X HEAD -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'User-Agent: python-glanceclient' -H 'Connection: keep-alive' -H 'X-Auth-Token: {SHA1}1e5ffd286b348fd2232645b4f21adbd41e27d447' -H 'Content-Type: application/octet-stream' http://172.27.162.241:9292/v1/images/e20fae04-35b1-42f4-9025-2712be7396e0

HTTP/1.1 200 OK
Content-Length: 0
X-Image-Meta-Id: e20fae04-35b1-42f4-9025-2712be7396e0
X-Image-Meta-Deleted: False
X-Image-Meta-Checksum: 64d7c1cd2b6f60c92c14662941cb7913
X-Image-Meta-Status: active
X-Image-Meta-Container_format: bare
X-Image-Meta-Protected: False
X-Image-Meta-Min_disk: 0
X-Image-Meta-Min_ram: 0
X-Image-Meta-Created_at: 2015-08-21T21:26:27.000000
X-Image-Meta-Size: 13167616
Connection: keep-alive
Etag: 64d7c1cd2b6f60c92c14662941cb7913
X-Image-Meta-Is_public: True
Date: Mon, 24 Aug 2015 14:28:26 GMT
X-Image-Meta-Owner: 6880ca64ebd04c10ad81b92eb0a890c0
X-Image-Meta-Updated_at: 2015-08-21T21:26:30.000000
Content-Type: text/html; charset=UTF-8
X-Openstack-Request-Id: req-6b63d869-0069-44cb-83f4-cbe77aa1ee0e
X-Image-Meta-Disk_format: qcow2
X-Image-Meta-Name: cirros-0.3.2-x86_64-disk

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/glanceclient/shell.py", line 667, in main
    args.func(client, args)
  File "/usr/lib/python2.7/site-packages/glanceclient/v1/shell.py", line 142, in do_image_show
    image_id = utils.find_resource(gc.images, args.image).id
  File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 491, in __getattr__
    self.get()
  File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 509, in get
    new = self.manager.get(self.id)
  File "/usr/lib/python2.7/site-packages/glanceclient/openstack/common/apiclient/base.py", line 494, in __getattr__
    raise AttributeError(k)
AttributeError: id
id

What I have also found is that if I pull python-glanceclient from the git.openstack.org and move it into site-packages, I still get the same version reported, BUT it now works.

[e@devstack site-packages]$ glance --version
0.19.0
[e@devstack site-packages]$ glance image-show e20fae04-35b1-42f4-9025-2712be7396e0
+------------------+--------------------------------------+
| Property | Value |
+------------------+--------------------------------------+
| checksum | 64d7c1cd2b6f60c92c14662941cb7913 |
| container_format | bare |
| created_at | 2015-08-21T21:26:27Z |
| disk_format | qcow2 |
| id | e20fae04-35b1-42f4-9025-2712be7396e0 |
| min_disk | 0 |
| min_ram | 0 |
| name | cirros-0.3.2-x86_64-disk |
| owner | 6880ca...

Read more...

Revision history for this message
Flavio Percoco (flaper87) wrote :

This might be related to https://bugs.launchpad.net/python-glanceclient/+bug/1476770

I'll keep looking into it

Revision history for this message
Emilien Macchi (emilienm) wrote :
Download full text (1.3 MiB)

So I don't have the issue in RDO trunk right now (Liberty).

See output:

FailedConsole Output

2015-08-25 13:07:01.721 | Started by user anonymous
2015-08-25 13:07:01.722 | [EnvInject] - Loading node environment variables.
2015-08-25 13:07:05.546 | Building remotely on devstack-centos7-hpcloud-b3-4517871 (devstack-centos7) in workspace /home/jenkins/workspace/gate-puppet-openstack-integration-dsvm-centos7
2015-08-25 13:07:06.133 | [gate-puppet-openstack-integration-dsvm-centos7] $ /bin/sh /tmp/hudson6094296708933848930.sh
2015-08-25 13:07:06.813 | Detailed logs: http://logs.openstack.org/94/216694/1/check/gate-puppet-openstack-integration-dsvm-centos7/efc827b//
2015-08-25 13:07:07.168 | [gate-puppet-openstack-integration-dsvm-centos7] $ /bin/bash /tmp/hudson3488950356828175082.sh
2015-08-25 13:07:07.480 | INFO:zuul.CloneMapper:Workspace path set to: /home/jenkins/workspace/gate-puppet-openstack-integration-dsvm-centos7
2015-08-25 13:07:07.480 | INFO:zuul.CloneMapper:Mapping projects to workspace...
2015-08-25 13:07:07.480 | INFO:zuul.CloneMapper: openstack/puppet-openstack-integration -> /home/jenkins/workspace/gate-puppet-openstack-integration-dsvm-centos7/openstack/puppet-openstack-integration
2015-08-25 13:07:07.480 | INFO:zuul.CloneMapper:Expansion completed.
2015-08-25 13:07:07.480 | INFO:zuul.Cloner:Preparing 1 repositories
2015-08-25 13:07:07.481 | INFO:zuul.Cloner:Creating repo openstack/puppet-openstack-integration from cache file:///opt/git/openstack/puppet-openstack-integration
2015-08-25 13:07:07.528 | INFO:zuul.Cloner:Updating origin remote in repo openstack/puppet-openstack-integration to git://git.openstack.org/openstack/puppet-openstack-integration
2015-08-25 13:07:07.936 | INFO:zuul.Cloner:upstream repo has branch master
2015-08-25 13:07:08.411 | INFO:zuul.Cloner:Prepared openstack/puppet-openstack-integration repo with commit 2d92d4171d4e1b20b7afa7b413884c91dc2f0b44
2015-08-25 13:07:08.411 | INFO:zuul.Cloner:Prepared all repositories
2015-08-25 13:07:08.615 | [gate-puppet-openstack-integration-dsvm-centos7] $ /bin/bash -xe /tmp/hudson4866344334000611000.sh
2015-08-25 13:07:08.621 | + cd openstack/puppet-openstack-integration
2015-08-25 13:07:08.621 | + mkdir .bundled_gems
2015-08-25 13:07:08.622 | ++ pwd
2015-08-25 13:07:08.622 | + export GEM_HOME=/home/jenkins/workspace/gate-puppet-openstack-integration-dsvm-centos7/openstack/puppet-openstack-integration/.bundled_gems
2015-08-25 13:07:08.622 | + GEM_HOME=/home/jenkins/workspace/gate-puppet-openstack-integration-dsvm-centos7/openstack/puppet-openstack-integration/.bundled_gems
2015-08-25 13:07:08.622 | + gem install bundler --no-rdoc --no-ri --verbose
2015-08-25 13:07:10.489 | GET https://rubygems.org/latest_specs.4.8.gz
2015-08-25 13:07:10.489 | 302 Moved Temporarily
2015-08-25 13:07:10.489 | GET https://rubygems.global.ssl.fastly.net/latest_specs.4.8.gz
2015-08-25 13:07:10.489 | 200 OK
2015-08-25 13:07:10.489 | GET https://rubygems.org/quick/Marshal.4.8/bundler-1.10.6.gemspec.rz
2015-08-25 13:07:10.489 | 302 Moved Temporarily
2015-08-25 13:07:10.489 | GET https://rubygems.global.ssl.fastly.net/quick/Marshal.4.8/bundler-1.10.6.gemspec.rz
2015-08-25 13:07:10.490 | 200 O...

Revision history for this message
Emilien Macchi (emilienm) wrote :

I'm sorry for my last comment, the copy/paste was not supposed to be so huge.
My bad again, next time I'll use pastebin.

Revision history for this message
Emilien Macchi (emilienm) wrote :

I have the same issue on Trusty:

2015-08-25 13:27:09.091 | + glance --version
2015-08-25 13:27:09.560 | 0.19.0
2015-08-25 13:27:09.561 | + openstack --os-username glance --os-password a_big_secret --os-tenant-name services --os-auth-url http://127.0.0.1:5000/v2.0 image list
2015-08-25 13:27:16.271 | +--------------------------------------+------------+
2015-08-25 13:27:16.272 | | ID | Name |
2015-08-25 13:27:16.272 | +--------------------------------------+------------+
2015-08-25 13:27:16.272 | | 86a62ccc-fbfc-4db1-bd8b-3faefbff8e67 | cirros_alt |
2015-08-25 13:27:16.273 | | ec3680e0-d58c-491a-961b-f1c883ad762a | cirros |
2015-08-25 13:27:16.273 | +--------------------------------------+------------+
2015-08-25 13:27:16.275 | ++ openstack --os-username glance --os-password a_big_secret --os-tenant-name services --os-auth-url http://127.0.0.1:5000/v2.0 image list
2015-08-25 13:27:16.276 | ++ grep cirros_alt
2015-08-25 13:27:16.277 | ++ awk '{print $2}'
2015-08-25 13:27:20.275 | + ID=86a62ccc-fbfc-4db1-bd8b-3faefbff8e67
2015-08-25 13:27:20.275 | + openstack --os-username glance --os-password a_big_secret --os-tenant-name services --os-auth-url http://127.0.0.1:5000/v2.0 image show 86a62ccc-fbfc-4db1-bd8b-3faefbff8e67
2015-08-25 13:27:20.276 | +------------+-------+
2015-08-25 13:27:20.276 | | Field | Value |
2015-08-25 13:27:20.276 | +------------+-------+
2015-08-25 13:27:20.276 | | properties | {} |
2015-08-25 13:27:20.277 | +------------+-------+

Chuck Short (zulcss)
no longer affects: ubuntu
Changed in python-glanceclient (Ubuntu):
status: New → Confirmed
tags: added: 1.0.0-potential
Changed in python-glanceclient:
importance: Undecided → Critical
assignee: nobody → David (dsariel)
Changed in python-glanceclient:
status: Confirmed → In Progress
Revision history for this message
James Page (james-page) wrote :

Confirmed for liberty-staging PPA; I tested with just upgrading glanceclient (which worked OK) and then picking up all of the dependency bumps - at which point I get 'id' back for image-show.

Looks likely this is a requests/urllib3 type problem

Changed in python-glanceclient (Ubuntu):
importance: Undecided → High
Revision history for this message
James Page (james-page) wrote :

Downgrading urllib3 to 1.10.4 resolves the problem; but we do need to move forwards on identifying the root cause of this problem.

Changed in python-glanceclient (Ubuntu):
status: Confirmed → Triaged
Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in python-urllib3 (Ubuntu):
status: New → Confirmed
Changed in requests (Ubuntu):
status: New → Confirmed
Revision history for this message
Ian Cordasco (icordasc) wrote :

The cause is the following:

- oslo.vmware requires urllib3 and if that requirement is uncapped, it installs 1.11
- no one tends to install over the default system python-requests which is 2.2.1
- for an unexplained reason, urllib3 1.11 and requests 2.2.1 do not mix nor will they mix (I'm not going to dig into why urllib3 1.11 broke requests 2.2.1 because 2.2.1 is absolutely ancient)

The solutions:

- install a version of requests from this year
- cap urllib3

Changed in python-glanceclient:
status: In Progress → Invalid
Revision history for this message
James Page (james-page) wrote :

even the latest version of requests (2.7.0) does not support urllib3 1.11, so for Ubuntu/Debian this does not resolve the problem - I've spoken with upstream requests to see if we can get a patch to resolve this for the 2.7.0/1.11 combination we have right now.

For upstream development, capping the urllib3 version requirement makes sense until requests releases a version that supports 1.11.

James Page (james-page)
Changed in python-urllib3 (Ubuntu):
importance: Undecided → High
Changed in requests (Ubuntu):
status: Confirmed → Triaged
Changed in python-urllib3 (Ubuntu):
status: Confirmed → Triaged
Changed in requests (Ubuntu):
importance: Undecided → High
Revision history for this message
James Page (james-page) wrote :

Looking at https://github.com/shazow/urllib3/pull/679, it would appear that urllib3 switch behaviour to preserve case sensitivity for headers; requests is just passing this through to glanceclient, which is coded on the previous behaviour where headers where converted to lowercase automatically.

James Page (james-page)
Changed in python-glanceclient:
status: Invalid → New
Changed in python-urllib3 (Ubuntu):
status: Triaged → Invalid
Changed in python-glanceclient (Ubuntu):
status: Triaged → In Progress
assignee: nobody → James Page (james-page)
Changed in requests (Ubuntu):
status: Triaged → Invalid
Revision history for this message
James Page (james-page) wrote :

Hooking things up - https://review.openstack.org/#/c/219338/

This fix is required for compatibility with urllib3 >= 1.11

Changed in python-glanceclient:
status: New → In Progress
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package python-glanceclient - 1:0.19.0-1ubuntu2

---------------
python-glanceclient (1:0.19.0-1ubuntu2) wily; urgency=medium

  * d/p/urllib3-1.11-compat.patch: Fix compatibility with urllib3
    >= 1.11 (LP: #1487645).
  * d/p/mock-compat.patch: Fixup compatibility with mock >= 1.1.0,
    resolving FTBFS.

 -- James Page <email address hidden> Tue, 08 Sep 2015 12:01:58 +0100

Changed in python-glanceclient (Ubuntu):
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to python-glanceclient (master)

Reviewed: https://review.openstack.org/219338
Committed: https://git.openstack.org/cgit/openstack/python-glanceclient/commit/?id=2c7da7cb6077b89a7e195f76ed092ea7dfe65e02
Submitter: Jenkins
Branch: master

commit 2c7da7cb6077b89a7e195f76ed092ea7dfe65e02
Author: David Sariel <email address hidden>
Date: Wed Sep 2 14:48:17 2015 +0300

    Invalid output running the command 'glance image-show <image_id>'

    Running the command returns the string 'id' and fails on exception.
    In function _image_meta_from_headers the meta variable was not properly
    set because key was not lowercased. Converting key to lowercase solves
    the problem.

    NOTE: this is a compatibility fix for urllib3 >= 1.11

    Closes-Bug: #1487645
    Co-Authored-by: Flavio Percoco <email address hidden>
    Change-Id: I1b0b327163577585becb5e762536058d21dc1c98

Changed in python-glanceclient:
status: In Progress → Fix Committed
Changed in python-glanceclient:
milestone: none → 1.1.0
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to python-glanceclient (stable/kilo)

Fix proposed to branch: stable/kilo
Review: https://review.openstack.org/244748

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on python-glanceclient (stable/kilo)

Change abandoned by Rawlin Peters (<email address hidden>) on branch: stable/kilo
Review: https://review.openstack.org/244748

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.