glanceclient raises unhandled CommunicationError during glance service restart resulting in removed simplestreams-sync cron

Bug #1580301 reported by Chad Smith
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Landscape Server
Fix Released
Medium
Chad Smith
16.06
Fix Released
Medium
Chad Smith
glance-simplestreams-sync (Juju Charms Collection)
Fix Released
Medium
Chad Smith

Bug Description

glance-simplestreams-sync only handles glanceclient.exc.ClientException and leaves the fastpoll cron job intact. But, glanceclient also raises exc.CommunicationError on a broken glance pipe due to glance service restart.

    return self._http_request(url, method, **kwargs)
  File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 235, in _http_request
    raise exc.CommunicationError(message=message)
CommunicationError: Error communicating with http://10.1.7.237:9292 [Errno 32] Broken pipe

Full traceback: https://pastebin.canonical.com/156159/

 This unhandled error results in removal of the cron job and simplestreams-sync is then dead in the water and doesn't retry so waiting for the sync service to resurrect images is pointless.

I was able to succeed with the image sync running the script manually after the cron was removed per the above traceback showing that this error type was intermittent.

Tags: landscape

Related branches

Revision history for this message
Andreas Hasenack (ahasenack) wrote :

Added landscape tasks to update the charm store revision for glance-simplestreams-sync once the fix lands there.

tags: added: kanban-cross-team
tags: removed: kanban-cross-team
Chad Smith (chad.smith)
Changed in glance-simplestreams-sync (Juju Charms Collection):
assignee: nobody → Chad Smith (chad.smith)
assignee: Chad Smith (chad.smith) → nobody
Changed in landscape:
importance: Undecided → Medium
Chad Smith (chad.smith)
Changed in glance-simplestreams-sync (Juju Charms Collection):
status: New → Fix Committed
assignee: nobody → Chad Smith (chad.smith)
status: Fix Committed → New
assignee: Chad Smith (chad.smith) → nobody
Chad Smith (chad.smith)
Changed in landscape:
status: New → In Progress
Changed in glance-simplestreams-sync (Juju Charms Collection):
status: New → In Progress
assignee: nobody → Chad Smith (chad.smith)
Changed in landscape:
assignee: nobody → Chad Smith (chad.smith)
Changed in glance-simplestreams-sync (Juju Charms Collection):
status: In Progress → Fix Committed
Changed in landscape:
milestone: none → 16.06
status: In Progress → Fix Committed
Changed in landscape:
status: Fix Committed → Fix Released
James Page (james-page)
Changed in glance-simplestreams-sync (Juju Charms Collection):
importance: Undecided → Medium
James Page (james-page)
Changed in glance-simplestreams-sync (Juju Charms Collection):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.