Repo http://mirror.fuel-infra.org/mos-repos/ubuntu was unreachable

[Nastya Urlapova]

Test separate_haproxy failed on ISO #485, because download of some packages finished with 404 error:
request failed: http://mirror.fuel-infra.org/mos-repos/ubuntu/9.0/pool/main/t/twemproxy/twemproxy_0.4.1-2~u14.04+mos1_amd64.deb - 404(Not Found), retries left - 2.
Task failed: HTTP Error 404: Not Found
request failed: http://mirror.fuel-infra.org/mos-repos/ubuntu/9.0/pool/main/p/python-pkginfo/python3-pkginfo_1.1-2~u14.04+mos1_all.deb - 404(Not Found), retries left - 2.
Task failed: HTTP Error 404: Not Found

Full is here https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.plugins.thread_separate_haproxy/9/testReport/(root)/separate_haproxy/separate_haproxy/

I guess it was some sporadic issue with mirrors, but it would be nice if infra folks will do investigation of failure.

ISO #485

[Bug Checker Bot (bug-checker)]

(This check performed automatically)
Please, make sure that bug description contains the following sections filled in with the appropriate data related to the bug you are describing:

actual result

expected result

steps to reproduce

For more detailed information on the contents of each of the listed sections see https://wiki.openstack.org/wiki/Fuel/How_to_contribute#Here_is_how_you_file_a_bug

[Igor Shishkin (teran)]

Build-team, I see pretty strange issue here:

Here's stat output for one of failed packages

# stat /var/www/mirror/mos-repos/ubuntu/9.0/pool/main/p/python-novaclient/python-novaclient_3.3.1-4~u14.04+mos1_all.deb
  File: ‘/var/www/mirror/mos-repos/ubuntu/9.0/pool/main/p/python-novaclient/python-novaclient_3.3.1-4~u14.04+mos1_all.deb’
  Size: 245952 Blocks: 488 IO Block: 4096 regular file
Device: 900h/2304d Inode: 191104720 Links: 2607
Access: (0755/-rwxr-xr-x) Uid: ( 995/mirror-syncer) Gid: ( 995/mirror-syncer)
Access: 2016-05-25 15:24:06.087351381 +0000
Modify: 2016-05-23 09:42:11.214410633 +0000
Change: 2016-06-23 16:42:37.239228498 +0000
 Birth: -

As you can see file was placed on mirrors 06/23, do we had any issues anywhere in sync chain?

[Dmitry Burmistrov (dburmistrov)]

Till 2016.06.22 all main repositories symlinks like "mos-repos/ubuntu/9.0" were recreating every 15 min. Since 2016.06.22 it is recreating on demand, if there is new changes in the repo.
To avoid such issues need to dereferece main symlinks with files like "mos-repos/ubuntu/9.0.target.txt" before running tests

[Roman Vyalov (r0mikiam)]

marked as wontfix for 10.0