victoria promotion: multinode-ipa and fs039 tests are failing "ansible_fqdn' is undefined"

Bug #1923248 reported by Ronelle Landy
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
David Wilde

Bug Description

periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-security-victoria and periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-victoria are failing with the same error:

2021-04-09 15:50:36.849095 | fa163ebf-5861-315e-4ede-000000000d7c | FATAL | set main facts | undercloud | error={"msg": "The task includes an option with an undefined variable. The error was: 'ansible_fqdn' is undefined\n\nThe error appears to be in '/usr/share/ansible/roles/tripleo_ipa_registration/tasks/main.yml': line 27, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: set main facts\n ^ here\n"}
2021-04-09 15:50:36.850633 | fa163ebf-5861-3

Full logs are included below:

https://logserver.rdoproject.org/openstack-component-security/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-security-victoria/59a0b73/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz

https://logserver.rdoproject.org/openstack-periodic-integration-stable2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-victoria/162247c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz

The error looks to come from:

https://logserver.rdoproject.org/openstack-periodic-integration-stable2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-victoria/162247c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz

Simliar tests are passing in master integration line but failing in https://review.rdoproject.org/zuul/builds?pipeline=openstack-component-security.

Last passes of the victoria tests are around 03/30 (03/26)

Ronelle Landy (rlandy)
tags: added: ci promotion-blocker
Changed in tripleo:
milestone: none → wallaby-rc1
importance: Undecided → Critical
status: New → Triaged
Revision history for this message
Ronelle Landy (rlandy) wrote :
Revision history for this message
David Wilde (dave-wilde) wrote :

The previous fix was abandoned as this was affecting both the overcloud and undercloud. We have fully resolved this in [1] and are in the process of backporting to stable/victoria [2].

[1]: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/785909
[2]: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/785918

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/ussuri)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-heat-templates (stable/train)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/victoria)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/785918
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/e1998a8e58b68c67979d30e4213c772169624484
Submitter: "Zuul (22348)"
Branch: stable/victoria

commit e1998a8e58b68c67979d30e4213c772169624484
Author: Dave Wilde (d34dh0r53) <email address hidden>
Date: Mon Apr 12 10:38:17 2021 -0500

    Ensure ansible_fqdn is set

    The ipaclient ansible role requires that ansible_fqdn is defined but
    due to [1] we don't have ansible_fqdn inside of ansible_facts. This
    uses the 'fqdn' ansible fact for ansible_fqdn which is equivalent.

    [1]: https://opendev.org/openstack/tripleo-heat-templates/commit/4e79336d69e
    6b7fa4b026922bac7953bafeee96d

    Related-Bug: 1915761
    Closes-Bug: 1923248
    Change-Id: I0a740e86588c96fff24fa09698c35e492d1c64db

tags: added: in-stable-victoria
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (stable/train)

Related fix proposed to branch: stable/train
Review: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/786321

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/ussuri)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/786219
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/1325566bad778b0d2d174833698ff41f46524948
Submitter: "Zuul (22348)"
Branch: stable/ussuri

commit 1325566bad778b0d2d174833698ff41f46524948
Author: Dave Wilde (d34dh0r53) <email address hidden>
Date: Mon Apr 12 10:38:17 2021 -0500

    Ensure ansible_fqdn is set

    The ipaclient ansible role requires that ansible_fqdn is defined but
    due to [1] we don't have ansible_fqdn inside of ansible_facts. This
    uses the 'fqdn' ansible fact for ansible_fqdn which is equivalent.

    [1]: https://opendev.org/openstack/tripleo-heat-templates/commit/4e79336d69e
    6b7fa4b026922bac7953bafeee96d

    Related-Bug: 1915761
    Closes-Bug: 1923248
    Change-Id: I0a740e86588c96fff24fa09698c35e492d1c64db

tags: added: in-stable-ussuri
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-heat-templates (stable/train)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/786220
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/f24840a56133f8862a521391c1cf14b1f29a0211
Submitter: "Zuul (22348)"
Branch: stable/train

commit f24840a56133f8862a521391c1cf14b1f29a0211
Author: Dave Wilde (d34dh0r53) <email address hidden>
Date: Mon Apr 12 10:38:17 2021 -0500

    Ensure ansible_fqdn is set

    The ipaclient ansible role requires that ansible_fqdn is defined but
    due to [1] we don't have ansible_fqdn inside of ansible_facts. This
    uses the 'fqdn' ansible fact for ansible_fqdn which is equivalent.

    [1]: https://opendev.org/openstack/tripleo-heat-templates/commit/4e79336d69e
    6b7fa4b026922bac7953bafeee96d

    Related-Bug: 1915761
    Closes-Bug: 1923248
    Change-Id: I0a740e86588c96fff24fa09698c35e492d1c64db

tags: added: in-stable-train
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (stable/train)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/786321
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/0de9ea84ff7a144c89c5a6cee0c68dabb571583a
Submitter: "Zuul (22348)"
Branch: stable/train

commit 0de9ea84ff7a144c89c5a6cee0c68dabb571583a
Author: Dave Wilde (d34dh0r53) <email address hidden>
Date: Wed Apr 14 15:21:21 2021 -0500

    [Train Only] Ensure novajoin code is setting ansible_fqdn

    Novajoin tls-e code is still available in train and is affected by
    the same removal of the fact passing as [1]. This uses
    ansible_facts['fqdn'] as the ansible_fqdn for the tripleo-ipa
    registration play.

    [1]: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/785909

    Related-Bug: 1915761
    Related-Bug: 1923248
    Change-Id: I5b1514b4ba9bb22bcef63e74b0400cd9332516ca

David Wilde (dave-wilde)
Changed in tripleo:
assignee: nobody → David Wilde (dave-wilde)
Ronelle Landy (rlandy)
Changed in tripleo:
status: Triaged → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 14.1.0

This issue was fixed in the openstack/tripleo-heat-templates 14.1.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 13.3.0

This issue was fixed in the openstack/tripleo-heat-templates 13.3.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 11.6.0

This issue was fixed in the openstack/tripleo-heat-templates 11.6.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/tripleo-heat-templates 12.4.4

This issue was fixed in the openstack/tripleo-heat-templates 12.4.4 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.