[devops] Jenkins runs tests with corrupted (not downloaded completely) iso image

Bug #1394613 reported by Artem Panchenko
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Igor Shishkin

Bug Description

This issue was reproduced here:

http://jenkins-product.srt.mirantis.net:8080/job/6.0.ubuntu.promo_bvt/50/consoleFull

Jenkins started system tests with Fuel image that wasn't downloaded completely, md5sum shows that it is corrupt:

original iso on the node where it was built
apanchenko@mc0n1-msk:~$ md5sum /var/www/fuelweb-iso/fuel-6.0-120-2014-11-20_12-44-18.iso
e1367b6bb5032e22e7470559b5d1fd18 /var/www/fuelweb-iso/fuel-6.0-120-2014-11-20_12-44-18.iso

iso, which was given to tests that failed to setup master node
apanchenko@mc2n3-srt:~$ md5sum /home/jenkins/workspace/6.0.ubuntu.promo_bvt/fuel-6.0-120-2014-11-20_12-44-18.iso
d41d8cd98f00b204e9800998ecf8427e /home/jenkins/workspace/6.0.ubuntu.promo_bvt/fuel-6.0-120-2014-11-20_12-44-18.iso

I think we can introduce some verification in jobs on CI that Fuel image is downloaded correctly before starting system tests.

Mike Scherbakov (mihgen)
Changed in fuel:
importance: Undecided → Critical
Revision history for this message
Igor Shishkin (teran) wrote :

It reproduces from time to time and we're working on fix right now.
So high instead of critical.

Changed in fuel:
importance: Critical → High
status: New → Confirmed
Igor Shishkin (teran)
tags: added: seed
Revision history for this message
Igor Shishkin (teran) wrote :

Wasn't reproduced for last time, but bug is still actual.

Changed in fuel:
milestone: 6.0 → 6.1
Revision history for this message
Sergey Kulanov (skulanov) wrote :

The issue appears due to running /usr/bin/seedcleaner.py by CRON:
Please see some latest logs

http://jenkins-product.srt.mirantis.net:8080/view/custom_iso/job/custom.centos.bvt_1/382/consoleFull

in syslog:

Dec 8 14:00:01 srv26-bud CRON[32113]: (root) CMD ( /usr/bin/seedcleaner.py)

Revision history for this message
Igor Shishkin (teran) wrote :
Revision history for this message
Igor Shishkin (teran) wrote :

The proposed patch could fix that problems.
Not changing status to get it for sure.

Igor Shishkin (teran)
Changed in fuel:
status: Confirmed → Fix Released
assignee: Fuel DevOps (fuel-devops) → Igor Shishkin (teran)
tags: added: system-test-not-required
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.