fuel 8.0 set up issue about fuel-bootstrap

[JohnsonYi]

Environment: mos 8.0/3controller+2(compute+cinder+lvm）+ 1ironic
fuel master node on virtualbox vm with internet access
slave nodes on baremetal servers

It's about command fuel-bootstrap for inronic:
fuel-bootstrap build --package 'openssh-server' --package 'ntp' --package 'fuel-agent' --package 'ubuntu-minimal' --package 'live-boot' --package 'wget' --package 'live-boot-initramfs-tools' --package 'squashfs-tools' --package 'linux-firmware' --package 'msmtp-mta' --package 'hpsa-dkms' --package 'i40e-dkms' --package 'linux-firmware-nonfree' --package 'xz-utils' --package 'linux-headers-generic' --root-ssh-authorized-file /var/lib/fuel/keys/1/ironic/ironic.pub --output-dir /var/www/nailgun/bootstrap/ironic/1/ --extra-dir /usr/share/ironic-fa-bootstrap-configs/ --no-compress --no-default-extra-dirs --no-default-packages --log-file /var/log/fuel-ironic-bootstrap-image-build.log

There are three errors:
1. No gpg key NO_PUBKEY BCE5CC461FA22B08 (it didn't work even I import the archive-mos8.0.key)
2. Miss folder /usr/share/ironic-fa-bootstrap-configs will cause sync failed
3. initctl: Unable to connect to Upstart

Error msgs I got from /var/log/fuel-ironic-bootstrap-image-build.log:
....
[2016-03-04 02:56:11,400] DEBUG fuel_agent.utils.utils Trying to execute command: chroot /tmp/tmpeNIzkP.fuel-agent-image apt-get -y update
[2016-03-04 02:58:58,009] DEBUG fuel_agent.utils.build Running apt-get update completed.
stdout: Ign http://127.0.0.1:8080 mos8.0 InRelease
Ign http://127.0.0.1:8080 mos8.0 Release.gpg
Get:1 http://127.0.0.1:8080 mos8.0 Release [2214 B]
Get:2 http://127.0.0.1:8080 mos8.0/main amd64 Packages [227 kB]
Get:3 http://127.0.0.1:8080 mos8.0/restricted amd64 Packages [14 B]
Ign http://127.0.0.1:8080 mos8.0/main Translation-en
Ign http://127.0.0.1:8080 mos8.0/restricted Translation-en
Ign http://mirror.fuel-infra.org mos8.0-holdback InRelease
Ign http://mirror.fuel-infra.org mos8.0-security InRelease
Get:4 http://archive.ubuntu.com trusty-security InRelease [65.9 kB]
Ign http://mirror.fuel-infra.org mos8.0-updates InRelease
Get:5 http://mirror.fuel-infra.org mos8.0-holdback Release.gpg [473 B]
Get:6 http://mirror.fuel-infra.org mos8.0-security Release.gpg [473 B]
Get:7 http://mirror.fuel-infra.org mos8.0-updates Release.gpg [473 B]
Get:8 http://mirror.fuel-infra.org mos8.0-holdback Release [9464 B]
Ign http://mirror.fuel-infra.org mos8.0-holdback Release
Get:9 http://mirror.fuel-infra.org mos8.0-security Release [9464 B]
Ign http://mirror.fuel-infra.org mos8.0-security Release
Get:10 http://mirror.fuel-infra.org mos8.0-updates Release [9462 B]
Ign http://mirror.fuel-infra.org mos8.0-updates Release
Get:11 http://archive.ubuntu.com trusty-updates InRelease [65.9 kB]
Ign http://archive.ubuntu.com trusty InRelease
Get:12 http://archive.ubuntu.com trusty-security/main amd64 Packages [430 kB]
Get:13 http://mirror.fuel-infra.org mos8.0-holdback/main amd64 Packages [20 B]
Get:14 http://mirror.fuel-infra.org mos8.0-holdback/restricted amd64 Packages [20 B]
Get:15 http://mirror.fuel-infra.org mos8.0-security/main amd64 Packages [20 B]
Get:16 http://mirror.fuel-infra.org mos8.0-security/restricted amd64 Packages [20 B]
Get:17 http://archive.ubuntu.com trusty-security/universe amd64 Packages [124 kB]
Get:18 http://mirror.fuel-infra.org mos8.0-updates/main amd64 Packages [20 B]
Get:19 http://mirror.fuel-infra.org mos8.0-updates/restricted amd64 Packages [20 B]
Ign http://mirror.fuel-infra.org mos8.0-holdback/main Translation-en
Ign http://mirror.fuel-infra.org mos8.0-holdback/restricted Translation-en
Ign http://mirror.fuel-infra.org mos8.0-security/main Translation-en
Ign http://mirror.fuel-infra.org mos8.0-security/restricted Translation-en
Ign http://mirror.fuel-infra.org mos8.0-updates/main Translation-en
Ign http://mirror.fuel-infra.org mos8.0-updates/restricted Translation-en
Get:20 http://archive.ubuntu.com trusty-security/multiverse amd64 Packages [4990 B]
Get:21 http://archive.ubuntu.com trusty-security/main Translation-en [235 kB]
Get:22 http://archive.ubuntu.com trusty-security/multiverse Translation-en [2570 B]
Get:23 http://archive.ubuntu.com trusty-security/universe Translation-en [72.9 kB]
Get:24 http://archive.ubuntu.com trusty-updates/main amd64 Packages [712 kB]
Get:25 http://archive.ubuntu.com trusty-updates/universe amd64 Packages [338 kB]
Get:26 http://archive.ubuntu.com trusty-updates/multiverse amd64 Packages [13.2 kB]
Get:27 http://archive.ubuntu.com trusty-updates/main Translation-en [360 kB]
Get:28 http://archive.ubuntu.com trusty-updates/multiverse Translation-en [6947 B]
Get:29 http://archive.ubuntu.com trusty-updates/universe Translation-en [180 kB]
Get:30 http://archive.ubuntu.com trusty Release.gpg [933 B]
Hit http://archive.ubuntu.com trusty Release
Hit http://archive.ubuntu.com trusty/main amd64 Packages
Get:31 http://archive.ubuntu.com trusty/universe amd64 Packages [5859 kB]
Get:32 http://archive.ubuntu.com trusty/multiverse amd64 Packages [132 kB]
Get:33 http://archive.ubuntu.com trusty/main Translation-en [762 kB]
Get:34 http://archive.ubuntu.com trusty/multiverse Translation-en [102 kB]
Get:35 http://archive.ubuntu.com trusty/universe Translation-en [4089 kB]
Fetched 13.8 MB in 2min 44s (83.9 kB/s)
Reading package lists...

stderr: W: GPG error: http://mirror.fuel-infra.org mos8.0-holdback Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY BCE5CC461FA22B08
W: GPG error: http://mirror.fuel-infra.org mos8.0-security Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY BCE5CC461FA22B08
W: GPG error: http://mirror.fuel-infra.org mos8.0-updates Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY BCE5CC461FA22B08

[2016-03-04 02:58:58,009] DEBUG fuel_agent.utils.utils Trying to execute command: chroot /tmp/tmpeNIzkP.fuel-agent-image apt-get -y dist-upgrade

...

The user `syslog' is already a member of `adm'.
Processing triggers for libc-bin (2.19-0ubuntu6.7) ...
Processing triggers for ca-certificates (20160104ubuntu0.14.04.1) ...
Updating certificates in /etc/ssl/certs... 35 added, 26 removed; done.
Running hooks in /etc/ca-certificates/update.d....done.
Processing triggers for initramfs-tools (0.103ubuntu4.2) ...

Extracting templates from packages: 100%

Current default time zone: 'Etc/UTC'
Local time is now: Fri Mar 4 03:07:35 UTC 2016.
Universal Time is now: Fri Mar 4 03:07:35 UTC 2016.
Run 'dpkg-reconfigure tzdata' if you wish to change it.

initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
invoke-rc.d: policy-rc.d denied execution of stop.
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
invoke-rc.d: policy-rc.d denied execution of stop.
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
invoke-rc.d: policy-rc.d denied execution of start.
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
invoke-rc.d: policy-rc.d denied execution of restart.
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
invoke-rc.d: policy-rc.d denied execution of start.
initctl: Unable to connect to Upstart: Failed to connect to socket /com/ubuntu/upstart: Connection refused
invoke-rc.d: policy-rc.d denied execution of restart.

[2016-03-04 03:08:05,337] DEBUG fuel_agent.utils.utils Trying to execute command: chroot /tmp/tmpeNIzkP.fuel-agent-image apt-get -y install i40e-dkms squashfs-tools linux-image-generic-lts-trusty xz-utils live-boot openssh-server ntp msmtp-mta linux-firmware-nonfree live-boot-initramfs-tools fuel-agent linux-firmware ubuntu-minimal wget hpsa-dkms linux-headers-generic

Thanks.

[JohnsonYi (yichengli)]

Fuel-bootstrap failed several times, I fixed this issue by add folder /usr/share/ironic-fa-bootstrap-configs and remove all files under /var/www/nailgun/bootstrap/ironic/1/ then run the build command again.

The following two errors didn't affect the openstack deployment:
1. No gpg key NO_PUBKEY BCE5CC461FA22B08 (it didn't work even I import the archive-mos8.0.key)
3. initctl: Unable to connect to Upstart

[Vasyl Saienko (vsaienko)]

@Johnson could you please check if ironic-fa-bootstrap-configs-8.0.0-1.mos237.noarch is installed inside mcollective container.

You can do it by:
1. dockerctl shell mcollective
2. rpm -qa |grep ironic

It should provide something like, if package is installed.
ironic-fa-bootstrap-configs-8.0.0-1.mos237.noarch

Please check for package installed files.
3. rpm -ql ironic-fa-bootstrap-configs-8.0.0-1.mos237.noarch

[JohnsonYi (yichengli)]

@Vasyl yes, the package is installed.

[root@fuel ~]# dockerctl list -l
Name Image Status Full container name
nginx fuel/nginx_8.0 Running fuel-core-8.0-nginx
rabbitmq fuel/rabbitmq_8.0 Running fuel-core-8.0-rabbitmq
astute fuel/astute_8.0 Running fuel-core-8.0-astute
rsync fuel/rsync_8.0 Running fuel-core-8.0-rsync
keystone fuel/keystone_8.0 Running fuel-core-8.0-keystone
postgres fuel/postgres_8.0 Running fuel-core-8.0-postgres
rsyslog fuel/rsyslog_8.0 Running fuel-core-8.0-rsyslog
nailgun fuel/nailgun_8.0 Running fuel-core-8.0-nailgun
cobbler fuel/cobbler_8.0 Running fuel-core-8.0-cobbler
ostf fuel/ostf_8.0 Running fuel-core-8.0-ostf
mcollective fuel/mcollective_8.0 Running fuel-core-8.0-mcollective
[root@fuel ~]# dockerctl shell mcollective
[root@fuel ~]#
[root@fuel ~]# dockctl shell mcollective
bash: dockctl: command not found
[root@fuel ~]# rpm -qa | grep ironic
ironic-fa-bootstrap-configs-8.0.0-1.mos237.noarch

[JohnsonYi (yichengli)]

@Vasyl

I ran the command fuel-bootstrap to generate inronic on fuel, but not in mcollective docker, maybe that's why the folder /usr/share/ironic-fa-bootstrap-configs missed.

[Vasyl Saienko (vsaienko)]

@Johnson: than you have to install ironic-fa-bootstrap-configs package or launch command inside mcollective container.

I have removing this bug from 9.0 since we do not using docker containers any more.
Marking this bug as Invalid for 8.0. Please feel free to open this bug it if you have any questions.