Master fs035 and fs064 failing on overcloud deploy on task "Render keystone-db-sync container definitions" with error - can only concatenate list (not "AnsibleUnicode") to list. Unexpected templating type error occurred on (image: "{{ tripleo_keystone_image }}"

Bug #1973863 reported by Sandeep Yadav
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Unassigned

Bug Description

Description:

Master fs035 and fs064 failing on overcloud deploy on task "Render keystone-db-sync container definitions" with error - can only concatenate list (not "AnsibleUnicode") to list. Unexpected templating type error occurred on (image: "{{ tripleo_keystone_image }}"

Log snippet:
~~~
2022-05-17 23:14:00 | 2022-05-17 23:14:00.860513 | fa163e1e-58de-d29d-abaa-000000008998 | FATAL | Render keystone-db-sync container definitions | overcloud1-controller-0 | error={"msg": "An unhandled exception occurred while templating '{'keystone_db_sync': "{{ lookup('template', 'keystone_db_sync.yaml.j2') | from_yaml }}"}'. Error was a <class 'ansible.errors.AnsibleError'>, original message: An unhandled exception occurred while running the lookup plugin 'template'. Error was a <class 'ansible.errors.AnsibleError'>, original message: Unexpected templating type error occurred on (image: "{{ tripleo_keystone_image }}"
net: host
user: root
privileged: false
detach: false
volumes:
  {% set keystone_volumes = [] %}
  {%- set keystone_volumes =
        keystone_volumes +
        tripleo_keystone_common_volumes +
        tripleo_keystone_volumes +
        tripleo_keystone_logging_volumes +
        tripleo_keystone_internal_tls_volumes -%}
  {%- if tripleo_keystone_enable_internal_tls -%}
  {%- set keystone_volumes =
          keystone_volumes + tripleo_keystone_internal_tls_ca_file -%}
  {%- endif -%}
  {{ keystone_volumes }}
environment: {{ tripleo_keystone_db_sync_environment | combine(tripleo_keystone_logging_environment | default({}, true)) }}
command: ['/usr/bin/bootstrap_host_exec', 'keystone', '/usr/local/bin/kolla_start']
): can only concatenate list (not "AnsibleUnicode") to list. Unexpected templating type error occurred on (image: "{{ tripleo_keystone_image }}"
net: host
user: root
privileged: false
detach: false
volumes:
  {% set keystone_volumes = [] %}
  {%- set keystone_volumes =
        keystone_volumes +
        tripleo_keystone_common_volumes +
        tripleo_keystone_volumes +
        tripleo_keystone_logging_volumes +
        tripleo_keystone_internal_tls_volumes -%}
  {%- if tripleo_keystone_enable_internal_tls -%}
  {%- set keystone_volumes =
          keystone_volumes + tripleo_keystone_internal_tls_ca_file -%}
  {%- endif -%}
  {{ keystone_volumes }}
environment: {{ tripleo_keystone_db_sync_environment | combine(tripleo_keystone_logging_environment | default({}, true)) }}
command: ['/usr/bin/bootstrap_host_exec', 'keystone', '/usr/local/bin/kolla_start']
): can only concatenate list (not "AnsibleUnicode") to list"}
2022-05-17 23:14:00 | 2022-05-17 23:14:00.862974 | fa163e1e-58de-d29d-abaa-000000008998 | TIMING | tripleo_container_standalone : Render keystone-db-sync container definitions | overcloud1-controller-0 | 0:24:23.008754 | 0.34s
~~~~

Logs url:

[1] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/83b5c72/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz
[2] https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-master/6ec8579/logs/undercloud/home/zuul/overcloud1_deploy.log.txt.gz

Revision history for this message
Cédric Jeanneret (cjeanner) wrote :

Reason:

we apparently try to concat a string (tripleo_keystone_internal_tls_ca_file[1]) with a list (keystone_volumes) - which is not possible, according to the error message.

The question now is:
- is that one potentially a list, so we'd have to change the default value, or is it always a string, so we'll need to change 3 templates[2] to properly append it to the list?

[1] https://opendev.org/openstack/tripleo-ansible/src/branch/master/tripleo_ansible/roles/tripleo_keystone/defaults/main.yml#L33

[2] https://opendev.org/openstack/tripleo-ansible/src/branch/master/tripleo_ansible/roles/tripleo_keystone/templates

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-ansible (master)
Changed in tripleo:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/842320

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-ci (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-ci/+/842356

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/842320
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/aa1ad7a5df4c7b1ccf7f43eecb59c09ede652536
Submitter: "Zuul (22348)"
Branch: master

commit aa1ad7a5df4c7b1ccf7f43eecb59c09ede652536
Author: Sandeep Yadav <email address hidden>
Date: Wed May 18 13:05:30 2022 +0000

    Revert "Use tripleo_keystone role"

    This reverts commit e9bc8e2a0dadf98c1e4778d83d81b8226130df89.

    Reason for revert: Broke ipa jobs

    Change-Id: I2f3d8d18598a5c24319e49b71f07055ccca07a7f
    Related-Bug: #1973863

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-heat-templates (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/842438

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-ci (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-ci/+/842356
Committed: https://opendev.org/openstack/tripleo-ci/commit/0ce424672a8a73c9b404f60eb0ef0ffc4b7aa9f8
Submitter: "Zuul (22348)"
Branch: master

commit 0ce424672a8a73c9b404f60eb0ef0ffc4b7aa9f8
Author: Sandeep Yadav <email address hidden>
Date: Wed May 18 18:48:56 2022 +0530

    Add keystone deployment files filter for ipa job

    In the related-bug because we didn't run IPA job
    we merged a patch that broke ipa job.

    Adding keystone deployment files in filter for
    ipa job.

    Related-Bug: #1973863
    Change-Id: I443272eae2ab496487cf488faa19c15c40357b4b

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-ansible (master)

Change abandoned by "Cedric Jeanneret <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/tripleo-ansible/+/842303
Reason: https://review.opendev.org/c/openstack/tripleo-ansible/+/842436

Revision history for this message
Sandeep Yadav (sandeepyadav93) wrote :

Marking as fix released as the original patch was reverted.

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-ansible (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-ansible/+/842436
Committed: https://opendev.org/openstack/tripleo-ansible/commit/56e724ad53a7c541431b8f783d9b3bce3c8f5d4c
Submitter: "Zuul (22348)"
Branch: master

commit 56e724ad53a7c541431b8f783d9b3bce3c8f5d4c
Author: James Slagle <email address hidden>
Date: Wed May 18 17:41:22 2022 -0400

    Fix setting volumes for internal tls

    Move the configuration of the internal tls volumes into the common
    tripleo_container_standalone role. The logic for adding the volumes when
    internal TLS is used is now in a single location.

    Updates the tripleo_keystone role to make use of the new variables from
    tripleo_container_standalone.

    Related-Bug: #1973863
    Change-Id: I84c8c15e9e5adbc3798edf0e4ca7717527d0de47
    Signed-off-by: James Slagle <email address hidden>

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-heat-templates (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/842438
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/5139180f3f009cd6ee6e86e308b1875174fd17bc
Submitter: "Zuul (22348)"
Branch: master

commit 5139180f3f009cd6ee6e86e308b1875174fd17bc
Author: James Slagle <email address hidden>
Date: Wed May 18 17:44:55 2022 -0400

    Revert "Revert "Use tripleo_keystone role""

    This revert to re-enable using tripleo_keystone depends on the patch to
    tripleo_keystone and tripleo_container_standalone that fixes the
    concatenation of volumes when internal tls is enabled.

    This reverts commit aa1ad7a5df4c7b1ccf7f43eecb59c09ede652536.
    Related-Bug: #1973863
    Depends-On: I84c8c15e9e5adbc3798edf0e4ca7717527d0de47
    Change-Id: I57dc45ba87a09a65cca4c735c7900bfe554be67d

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.