9.0 Image provisioning failing in environment with ironic enabled .

[krypto]

Fuel 9 with Ironic enabled.

regular image got created successfully but ironic image is failing.

fuel-ironic-bootstrap-image-build.log

[2016-10-20 11:37:50,811] DEBUG fuel_agent.utils.utils Trying to execute command: mkfs.ext4 /dev/loop0
[2016-10-20 11:37:52,431] DEBUG fuel_agent.utils.utils Trying to execute command: blkid -c /dev/null -o value -s UUID /dev/loop0
[2016-10-20 11:37:52,445] DEBUG fuel_agent.manager Trying to disable journaling for ext4 in order to speed up the build
[2016-10-20 11:37:52,445] DEBUG fuel_agent.utils.utils Trying to execute command: tune2fs -O ^has_journal /dev/loop0
[2016-10-20 11:37:52,472] DEBUG fuel_agent.manager Mounting target file systems: /tmp/tmpu3RgPr.fuel-agent-image
[2016-10-20 11:37:52,473] DEBUG fuel_agent.utils.utils Trying to execute command: mount -t ext4 /dev/loop0 /tmp/tmpu3RgPr.fuel-agent-image/
[2016-10-20 11:37:52,487] INFO fuel_agent.manager Installing BASE operating system into image
[2016-10-20 11:37:52,487] ERROR fuel_agent.manager Failed to build bootstrap image: list index out of range
[2016-10-20 11:37:52,487] INFO fuel_agent.manager Cleanup chroot
[2016-10-20 11:37:52,487] DEBUG fuel_agent.utils.utils Trying to execute command: fuser -v /tmp/tmpu3RgPr.fuel-agent-image
[2016-10-20 11:37:52,570] DEBUG fuel_agent.utils.build There are no running processes in /tmp/tmpu3RgPr.fuel-agent-image
[2016-10-20 11:37:52,570] DEBUG fuel_agent.manager Finally: umounting procfs /tmp/tmpu3RgPr.fuel-agent-image/proc
[2016-10-20 11:37:52,570] DEBUG fuel_agent.utils.utils Trying to execute command: mountpoint -q /tmp/tmpu3RgPr.fuel-agent-image/proc
[2016-10-20 11:37:52,575] WARNING fuel_agent.utils.utils Failed to execute command: Unexpected error while running command.
Command: mountpoint -q /tmp/tmpu3RgPr.fuel-agent-image/proc
Exit code: 1
Stdout: ''
Stderr: ''

Steps to reproduce:
1. Update fuel-bootstrap-cli package on master node
2. Create env with ironic,lvm,do os provisioning in one of the node

Expected Result:
Ubuntu Installed

Actual Result:

Provision has failed. Failed to execute hook 'shell' Failed to run command cd / && test -e /var/www/nailgun/bootstrap/ironic/2/vmlinuz || (fuel-bootstrap build --package 'openssh-server' --package 'ntp' --package 'fuel-agent' --package 'ubuntu-minimal' --package 'live-boot' --package 'wget' --package 'live-boot-initramfs-tools' --package 'squashfs-tools' --package 'linux-firmware' --package 'msmtp-mta' --package 'hpsa-dkms' --package 'i40e-dkms' --package 'linux-firmware-nonfree' --package 'xz-utils' --package 'linux-headers-generic' --root-ssh-authorized-file /var/lib/fuel/keys/2/ironic/ironic.pub --output-dir /var/www/nailgun/bootstrap/ironic/2/ --extra-dir /usr/share/ironic-fa-bootstrap-configs/ --no-compress --no-default-extra-dirs --no-default-packages --log-file /var/log/fuel-ironic-bootstrap-image-build.log) (node master returned 1).

Reproducability:
tried twice by deleting previous environment,same result ,also tried reset

[Alexey Stupnikov (astupnikov)]

This issue is caused by broken fuel_bootstrap_cli.yaml configuration file. It looks like it was changed after bootstrap images were built, since it breaks bootstrap image build process the same way. I was able to reproduce this bug after updating fuel-bootstrap-cli package (update replaced this file)

[Alexey Stupnikov (astupnikov)]

fuel_bootstrap_cli package is built with fuel-agent code, so we have to look at specs and stuff inside fuel-agent.

[Alexey Stupnikov (astupnikov)]

This bug is Invalid, since its root cause is incorrect package update procedure used by reporter. Fuel uses puppet manifests to configure installed services and sometimes it is essential to run them after package update.

This bug is caused by missing 'repos' configuration in /etc/fuel-bootstrap-cli/fuel_bootstrap_cli.yaml file. This configuration should be copied by puppet/fuel/examples/host.pp manifest from /etc/fuel/astute.yaml file.