nova doesn't always find images in glance in HA mode

Bug #1504902 reported by Steven Dake
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Fix Released
Critical
Sam Yaple

Bug Description

With 3 control nodes, glance has the following behavior:

Script started on Sat Oct 10 23:50:49 2015
[?1034hbash-3.2$ glance image-download --file abc 22e61335-73eb-410a-892c-5490c8abadb0
'NoneType' object has no attribute 'close'
bash-3.2$ glance image-download --file abc 22e61335-73eb-410a-892c-5490c8abadb0
'NoneType' object has no attribute 'close'
bash-3.2$ glance image-download --file abc 22e61335-73eb-410a-892c-5490c8abadb0
bash-3.2$ glance image-download --file abc 22e61335-73eb-410a-892c-5490c8abadb0
'NoneType' object has no attribute 'close'
bash-3.2$ glance image-download --file abc 22e61335-73eb-410a-892c-5490c8abadb0
'NoneType' object has no attribute 'close'
bash-3.2$ glance image-download --file abc 22e61335-73eb-410a-892c-5490c8abadb0

every third one works. Nova returns an error on access to glance api calls at same ratio.

Sam has indicated this is normal behavior for a storage backend of file. Sam suggested a solution which locks down the access to one glance api service (I believe) in this change:

https://review.openstack.org/#/c/233429/

Steven Dake (sdake)
Changed in kolla:
status: New → Confirmed
importance: Undecided → Critical
assignee: nobody → Sam Yaple (s8m)
milestone: none → liberty-rc3
Changed in kolla:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (master)

Reviewed: https://review.openstack.org/233429
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=0cefd644502c7a8851403cbb2e60dd79c906d475
Submitter: Jenkins
Branch: master

commit 0cefd644502c7a8851403cbb2e60dd79c906d475
Author: Sam Yaple <email address hidden>
Date: Sun Oct 11 07:22:37 2015 +0000

    Glance round robin for default file backend

    Closes-Bug: #1504902
    Change-Id: Id4cced68ef078adb3db19c67f62d96275ab2329f

Changed in kolla:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/liberty)

Fix proposed to branch: stable/liberty
Review: https://review.openstack.org/233593

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/liberty)

Reviewed: https://review.openstack.org/233593
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=4b0c088ad105151578e6239b544d8e52dd4f1800
Submitter: Jenkins
Branch: stable/liberty

commit 4b0c088ad105151578e6239b544d8e52dd4f1800
Author: Sam Yaple <email address hidden>
Date: Sun Oct 11 07:22:37 2015 +0000

    Glance round robin for default file backend

    Closes-Bug: #1504902
    Change-Id: Id4cced68ef078adb3db19c67f62d96275ab2329f
    (cherry picked from commit 0cefd644502c7a8851403cbb2e60dd79c906d475)

tags: added: in-stable-liberty
Sam Yaple (s8m)
Changed in kolla:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.