fs020, tempest, image corrupted after upload to glance (checksum mismatch)
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Fix Released
|
Critical
|
Unassigned |
Bug Description
Tempest jobs in FS 020 are failing, which is blocking promotion.
Image is uploaded:
However it looks like there's a checksum mismatch when nova attempts to build the instance:
RescheduledExce
===
Current build/status for this job can be found here:
- http://
This job failure is blocking promotion on master:
http://
<snip>
2018-03-07 13:51:31,829 16867 INFO promoter Skipping promotion of tripleo-ci-testing to current-tripleo, missing successful jobs: ['periodic-
</snip>
===
root cause not yet determined.
Changed in tripleo: | |
status: | New → Triaged |
importance: | Undecided → Critical |
Additional logs / investigation from arxcruz and chandankumar:
Tempest failure (summary):
https:/ /logs.rdoprojec t.org/openstack -periodic/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-master/ a049ff7/ tempest. html.gz
Glance logs:
- https:/ /logs.rdoprojec t.org/openstack -periodic/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-master/ a049ff7/ overcloud- controller- foo-0/var/ log/glance/ api.log. txt.gz# _2018-03- 06_11_14_ 40_514
===
- https:/ /logs.rdoprojec t.org/openstack -periodic/ periodic- tripleo- ci-centos- 7-ovb-1ctlr_ 1comp-featurese t020-master/ a049ff7/ overcloud- controller- foo-0/var/ log/glance/ api.log. txt.gz# _2018-03- 06_11_17_ 53_887
^^ looks like an error accessing data from store...
2018-03-06 11:17:53.258 26958 INFO eventlet. wsgi.server [req-5dc2dd26- 8695-4f7b- 9731-a2a0873f61 5d 862e52cc310742f b85300ea27f7b9f d6 75a077258684469 9b6fde3c6ee820e 20 - default default] 192.168.24.13 - - [06/Mar/2018 11:17:53] "GET /v2/schemas/image HTTP/1.1" 200 4333 0.004149
2018-03-06 11:17:53.887 26958 ERROR glance_ store._ drivers. swift.store [req-bcd76943- a8ab-495c- 943b-30a4cafb15 a4 862e52cc310742f b85300ea27f7b9f d6 75a077258684469 9b6fde3c6ee820e 20 - default default] Error during chunked upload to backend, deleting stale chunks.: IOError: unexpected end of file while parsing chunked data
2018-03-06 11:17:53.892 26958 ERROR glance. api.v2. image_data [req-bcd76943- a8ab-495c- 943b-30a4cafb15 a4 862e52cc310742f b85300ea27f7b9f d6 75a077258684469 9b6fde3c6ee820e 20 - default default] Failed to upload image data due to internal error: IOError: unexpected end of file while parsing chunked data
2018-03-06 11:17:53.929 26958 ERROR glance.common.wsgi [req-bcd76943- a8ab-495c- 943b-30a4cafb15 a4 862e52cc310742f b85300ea27f7b9f d6 75a077258684469 9b6fde3c6ee820e 20 - default default] Caught error: unexpected end of file while parsing chunked data: IOError: unexpected end of file while parsing chunked data
<stack_trace/>