Fuel bootstrap image build failed

[Ivan Udovichenko]

Fuel bootstrap image build failed [1] with error:
"""
Reading package lists...
Building dependency tree...
Reading state information...

E: Unable to locate package nailgun-agent
E: Unable to locate package nailgun-mcagents
E: Unable to locate package fuel-agent
E: Unable to locate package hpsa-dkms
"""

[1] https://product-ci.infra.mirantis.net/view/10.0/job/10.0.main.ubuntu.bvt_2/414/
ISO: magnet:?xt=urn:btih:d25aadbfe64a2d66a3a71e8a55244f9f496a4b9c&dn=fuel-10.0-486-2016-07-15%5F14-52-52.iso&tr=http%3A%2F%2Ftracker01-bud.infra.mirantis.net%3A8080%2Fannounce&tr=http%3A%2F%2Ftracker01-scc.infra.mirantis.net%3A8080%2Fannounce&tr=http%3A%2F%2Ftracker01-msk.infra.mirantis.net%3A8080%2Fannounce&ws=http%3A%2F%2Fsrv52-bud.infra.mirantis.net%2Ffuelweb-iso%2Ffuel-10.0-486-2016-07-15%5F14-52-52.iso

[Nastya Urlapova (aurlapova)]

Logs after 9.0 run:
https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.custom_graph/59/

[Dmitry Teselkin (teselkin-d)]

got an error: HTTPConnectionPool(host='mirror.seed-cz1.fuel-infra.org', port=80): Read timed out.
Traceback (most recent call last):
  File "/bin/fuel-bootstrap", line 10, in <module>
    sys.exit(main())
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/main.py", line 54, in main
    return fuel_bootstrap_app.run(argv)
  File "/usr/lib/python2.7/site-packages/cliff/app.py", line 255, in run
    result = self.run_subcommand(remainder)
  File "/usr/lib/python2.7/site-packages/cliff/app.py", line 374, in run_subcommand
    result = cmd.run(parsed_args)
  File "/usr/lib/python2.7/site-packages/cliff/command.py", line 54, in run
    self.take_action(parsed_args)
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/commands/build.py", line 177, in take_action
    image_uuid, path = bs_image.make_bootstrap(vars(parsed_args))
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/utils/bootstrap_image.py", line 174, in make_bootstrap
    mngr.do_mkbootstrap()
  File "/usr/lib/python2.7/site-packages/fuel_agent/manager.py", line 1020, in do_mkbootstrap
    direct_repo_addrs=driver_os.proxies.direct_repo_addr_list)
  File "/usr/lib/python2.7/site-packages/fuel_agent/manager.py", line 616, in _set_apt_repos
    proxies=proxies, direct_repo_addrs=direct_repo_addrs)
  File "/usr/lib/python2.7/site-packages/fuel_agent/utils/build.py", line 469, in add_apt_preference
    direct_repo_addrs=direct_repo_addrs))
  File "/usr/lib/python2.7/site-packages/fuel_agent/utils/build.py", line 394, in get_release_file
    noproxy_addrs=direct_repo_addrs).text
  File "/usr/lib/python2.7/site-packages/requests/models.py", line 761, in text
    if not self.content:
  File "/usr/lib/python2.7/site-packages/requests/models.py", line 734, in content
    self._content = bytes().join(self.iter_content(CONTENT_CHUNK_SIZE)) or bytes()
  File "/usr/lib/python2.7/site-packages/requests/models.py", line 664, in generate
    raise ConnectionError(e)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='mirror.seed-cz1.fuel-infra.org', port=80): Read timed out.

[Aleksandra Fedorova (bookwar)]

9.* failures cause by temporary network issues

[Timur Sufiev (tsufiev-x)]

Hit this issue again for 10.0.main.ubuntu.bvt_2 job

MAGNET_LINK=magnet:?xt=urn:btih:088b8c944d6bd851667987043a62a96f8cd51681&dn=fuel-10.0-572-2016-08-04%5F11-00-00.iso&tr=http%3A%2F%2Ftracker01-bud.infra.mirantis.net%3A8080%2Fannounce&tr=http%3A%2F%2Ftracker01-scc.infra.mirantis.net%3A8080%2Fannounce&tr=http%3A%2F%2Ftracker01-msk.infra.mirantis.net%3A8080%2Fannounce&ws=http%3A%2F%2Fsrv52-bud.infra.mirantis.net%2Ffuelweb-iso%2Ffuel-10.0-572-2016-08-04%5F11-00-00.iso

Stdout: 'Reading package lists...\nBuilding dependency tree...\nReading state information...\nubuntu-minimal is already the newest version (1.361).\nSome packages could not be installed. This may mean that you have\nrequested an impossible situation or if you are using the unstable\ndistribution that some required packages have not yet been created\nor been moved out of Incoming.\nThe following information may help to resolve the situation:\n\nThe following packages have unmet dependencies:\n network-checker : Depends: python-requests (>= 2.10.0) but 2.9.1-3 is to be installed\n'
Stderr: 'E: Unable to correct problems, you have held broken packages.\n'
Traceback (most recent call last):
  File "/bin/fuel-bootstrap", line 10, in <module>
    sys.exit(main())
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/main.py", line 59, in main
    return FuelBootstrap().run(argv)
  File "/usr/lib/python2.7/site-packages/cliff/app.py", line 226, in run
    result = self.run_subcommand(remainder)
  File "/usr/lib/python2.7/site-packages/cliff/app.py", line 346, in run_subcommand
    result = cmd.run(parsed_args)
  File "/usr/lib/python2.7/site-packages/cliff/command.py", line 55, in run
    self.take_action(parsed_args)
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/commands/build.py", line 176, in take_action
    image_uuid, path = bs_image.make_bootstrap(vars(parsed_args))
  File "/usr/lib/python2.7/site-packages/fuel_bootstrap/utils/bootstrap_image.py", line 174, in make_bootstrap
    mngr.do_mkbootstrap()
  File "/usr/lib/python2.7/site-packages/fuel_agent/manager.py", line 1039, in do_mkbootstrap
    attempts=CONF.fetch_packages_attempts)
  File "/usr/lib/python2.7/site-packages/fuel_agent/utils/build.py", line 115, in run_apt_get
    stdout, stderr = utils.execute(*cmds, attempts=attempts)
  File "/usr/lib/python2.7/site-packages/fuel_agent/utils/utils.py", line 140, in execute
    stderr=stderr, cmd=command)
fuel_agent.errors.ProcessExecutionError: Unexpected error while running command.

[Alexander Nagovitsyn (gluk12189)]

Have a got error on fuel-10.0-community-513-2016-08-10_05-14-00.iso fuel-10.0-community-517-2016-08-11_05-37-29.iso

2016-08-11 13:04:44.674 25862 ERROR fuel_agent.cmd.agent Command: chroot /var/lib/fuel/ibp/tmpxnmfbP.fuel-agent-image apt-get -y install acl anacron bash-completion bridge-utils bsdmainutils build-essential cloud-init curl daemonize debconf-utils gdisk grub-pc hpsa-dkms hwloc i40e-dkms linux-firmware linux-firmware-nonfree linux-headers-generic-lts-trusty linux-image-generic-lts-trusty lvm2 mcollective mdadm multipath-tools multipath-tools-boot nailgun-agent nailgun-mcagents network-checker ntp openssh-client openssh-server puppet python-amqp ruby-augeas ruby-ipaddress ruby-json ruby-netaddr ruby-openstack ruby-shadow ruby-stomp telnet ubuntu-minimal ubuntu-standard uuid-runtime vim virt-what vlan
2016-08-11 13:04:44.674 25862 ERROR fuel_agent.cmd.agent Exit code: 100
2016-08-11 13:04:44.674 25862 ERROR fuel_agent.cmd.agent Stdout: 'Reading package lists...\nBuilding dependency tree...\nReading state information...\n'
2016-08-11 13:04:44.674 25862 ERROR fuel_agent.cmd.agent Stderr: 'E: Unable to locate package hpsa-dkms\n'
2016-08-11 13:04:44.674 25862 ERROR fuel_agent.cmd.agent

[Dmitry Teselkin (teselkin-d)]

Can't find in BVT logs from community ISO 517 [1]:

---
dim@e5450 ~/Downloads/fuel-snapshot-2016-08-11_09-45-23 $ grep -rn 'Unable to locate package hpsa-dkms' *
dim@e5450 ~/Downloads/fuel-snapshot-2016-08-11_09-45-23 $ grep -rn 'tmpxnmfbP.fuel-agent-image' *
---

Can't find in BVT logs from community ISO 513 [2]:
---
dim@e5450 ~/Downloads/fuel-snapshot-2016-08-10_09-31-24 $ grep -rn 'tmpxnmfbP.fuel-agent-image' *
dim@e5450 ~/Downloads/fuel-snapshot-2016-08-10_09-31-24 $ grep -rn 'Unable to locate package hpsa-dkms' *
---

[1] https://ci.fuel-infra.org/job/10.0-community.main.ubuntu.bvt_2/468/
[2] https://ci.fuel-infra.org/job/10.0-community.main.ubuntu.bvt_2/464/

[Dmitry Teselkin (teselkin-d)]

Bootstrap image build was fixed with switching to Ubuntu Xenial.
Error string wasn't found in two latest community ISO builds.
Moving to invalid.