tripleo-ci OVB: Error: Could not run: Could not retrieve facts for localhost.localhost: no address for localhost.localhost

[James Slagle]

Looks like OVB CI jobs are failing during undercloud install with:

2016-07-28 11:06:54.585478 | 2016-07-28 11:06:50.000 | Running os-refresh-config
2016-07-28 11:06:54.585568 | 2016-07-28 11:06:50.000 | [2016-07-28 11:06:50,933] (os-refresh-config) [INFO] Starting phase configure
2016-07-28 11:06:54.585653 | 2016-07-28 11:06:50.000 | dib-run-parts Thu Jul 28 11:06:50 UTC 2016 Running /usr/libexec/os-refresh-config/configure.d/20-os-apply-config
2016-07-28 11:06:54.585731 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [WARNING] DEPRECATED: falling back to /var/run/os-collect-config/os_config_files.json
2016-07-28 11:06:54.585788 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] writing /etc/os-net-config/config.json
2016-07-28 11:06:54.585838 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] writing /root/stackrc
2016-07-28 11:06:54.585892 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] writing /etc/puppet/hiera.yaml
2016-07-28 11:06:54.585994 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] writing /var/opt/undercloud-stack/masquerade
2016-07-28 11:06:54.586075 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] writing /etc/puppet/hieradata/RedHat.yaml
2016-07-28 11:06:54.586140 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] writing /etc/puppet/hieradata/CentOS.yaml
2016-07-28 11:06:54.586200 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] writing /root/tripleo-undercloud-passwords
2016-07-28 11:06:54.586243 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [INFO] success
2016-07-28 11:06:54.586299 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 20-os-apply-config completed
2016-07-28 11:06:54.586375 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 Running /usr/libexec/os-refresh-config/configure.d/30-reload-keepalived
2016-07-28 11:06:54.586415 | 2016-07-28 11:06:51.000 | + systemctl is-enabled keepalived
2016-07-28 11:06:54.586475 | 2016-07-28 11:06:51.000 | Failed to get unit file state for keepalived.service: No such file or directory
2016-07-28 11:06:54.586533 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 30-reload-keepalived completed
2016-07-28 11:06:54.586608 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 Running /usr/libexec/os-refresh-config/configure.d/40-hiera-datafiles
2016-07-28 11:06:54.586682 | 2016-07-28 11:06:51.000 | [2016/07/28 11:06:51 AM] [WARNING] DEPRECATED: falling back to /var/run/os-collect-config/os_config_files.json
2016-07-28 11:06:54.586739 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 40-hiera-datafiles completed
2016-07-28 11:06:54.586817 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 Running /usr/libexec/os-refresh-config/configure.d/40-truncate-nova-config
2016-07-28 11:06:54.586851 | 2016-07-28 11:06:51.000 | + set -o pipefail
2016-07-28 11:06:54.586890 | 2016-07-28 11:06:51.000 | + '[' -f /etc/nova/nova.conf ']'
2016-07-28 11:06:54.586963 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 40-truncate-nova-config completed
2016-07-28 11:06:54.587055 | 2016-07-28 11:06:51.000 | dib-run-parts Thu Jul 28 11:06:51 UTC 2016 Running /usr/libexec/os-refresh-config/configure.d/50-puppet-stack-config
2016-07-28 11:06:54.587091 | 2016-07-28 11:06:51.000 | + set -o pipefail
2016-07-28 11:06:54.587157 | 2016-07-28 11:06:51.000 | + puppet_apply puppet apply --detailed-exitcodes /etc/puppet/manifests/puppet-stack-config.pp
2016-07-28 11:06:54.587185 | 2016-07-28 11:06:51.000 | + set +e
2016-07-28 11:06:54.587237 | 2016-07-28 11:06:51.000 | + awk '{print strftime("%Y-%m-%d %H:%M:%S") " - "$0; fflush()}'
2016-07-28 11:06:54.587298 | 2016-07-28 11:06:51.000 | + puppet apply --detailed-exitcodes /etc/puppet/manifests/puppet-stack-config.pp
2016-07-28 11:06:54.587386 | 2016-07-28 11:06:54.000 | 2016-07-28 11:06:54 - Error: Could not run: Could not retrieve facts for localhost.localhost: no address for localhost.localhost
2016-07-28 11:06:54.587414 | 2016-07-28 11:06:54.000 | + rc=1
2016-07-28 11:06:54.587442 | 2016-07-28 11:06:54.000 | + set -e
2016-07-28 11:06:54.587486 | 2016-07-28 11:06:54.000 | + echo 'puppet apply exited with exit code 1'
2016-07-28 11:06:54.587527 | 2016-07-28 11:06:54.000 | puppet apply exited with exit code 1
2016-07-28 11:06:54.587565 | 2016-07-28 11:06:54.000 | + '[' 1 '!=' 2 -a 1 '!=' 0 ']'
2016-07-28 11:06:54.587592 | 2016-07-28 11:06:54.000 | + exit 1
2016-07-28 11:06:54.587700 | 2016-07-28 11:06:54.000 | [2016-07-28 11:06:54,458] (os-refresh-config) [ERROR] during configure phase. [Command '['dib-run-parts', '/usr/libexec/os-refresh-config/configure.d']' returned non-zero exit status 1]
2016-07-28 11:06:54.587726 | 2016-07-28 11:06:54.000 |
2016-07-28 11:06:54.587779 | 2016-07-28 11:06:54.000 | [2016-07-28 11:06:54,458] (os-refresh-config) [ERROR] Aborting...
2016-07-28 11:06:54.587819 | 2016-07-28 11:06:54.000 | Traceback (most recent call last):
2016-07-28 11:06:54.587860 | 2016-07-28 11:06:54.000 | File "<string>", line 1, in <module>
2016-07-28 11:06:54.587928 | 2016-07-28 11:06:54.000 | File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 1121, in install
2016-07-28 11:06:54.588002 | 2016-07-28 11:06:54.000 | _run_orc(instack_env)
2016-07-28 11:06:54.588076 | 2016-07-28 11:06:54.000 | File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 999, in _run_orc
2016-07-28 11:06:54.588129 | 2016-07-28 11:06:54.000 | _run_live_command(args, instack_env, 'os-refresh-config')
2016-07-28 11:06:54.588200 | 2016-07-28 11:06:54.000 | File "/usr/lib/python2.7/site-packages/instack_undercloud/undercloud.py", line 492, in _run_live_command
2016-07-28 11:06:54.588253 | 2016-07-28 11:06:54.000 | raise RuntimeError('%s failed. See log for details.' % name)
2016-07-28 11:06:54.588303 | 2016-07-28 11:06:54.000 | RuntimeError: os-refresh-config failed. See log for details.
2016-07-28 11:06:54.588357 | 2016-07-28 11:06:54.000 | Command 'instack-install-undercloud' returned non-zero exit status 1

[James Slagle (james-slagle)]

could be caused by: https://review.openstack.org/#/c/347970/ that changed the dhclient.conf client options, resulting in some changes to resolv.conf.

Although, I'm not sure if that would affect the images we use in OVB. I know we build new images in those clouds based on the infra defintions, but i'm not sure if puppet-unbound is used or not.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/348264

[James Slagle (james-slagle)]

possibly fixed by https://review.openstack.org/348264

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/348264
Committed: https://git.openstack.org/cgit/openstack/instack-undercloud/commit/?id=6058e39c9804fc566936f2a4dbde9597e7c255f9
Submitter: Jenkins
Branch: master

commit 6058e39c9804fc566936f2a4dbde9597e7c255f9
Author: James Slagle <email address hidden>
Date: Thu Jul 28 07:51:31 2016 -0400

    Explicitly set $FACTER_fqdn

    Instead of letting puppet figure out the fqdn, tell it the right value
    to use. This will hopefully fix issues where puppet has detected a
    different fqdn than has actually been configured resulting in errors
    similar to:

    Could not run: Could not retrieve facts for localhost.localhost: no
    address for localhost.localhost

    Change-Id: I158766b711fbdfb907f5b3aeb8ad4d0e47570fe3
    Partial-Bug: #1607334

[Emilien Macchi (emilienm)]

Problem was fixed, OVB job are now running fine.