Periodic C8 Ceph Integration/ Ceph ansible integration jobs are failing. Error: msg": "The conditional check 'release is search(\"queens|rocky|stein|train\")' failed

[Sandeep Yadav]

Details:-
=======

Periodic Centos 8 Ceph Integration/ Ceph-ansible intregration jobs are failing.

Master/Ussuri/Train branch all are affected

Error:-
~~~
2020-06-28 12:29:37.846767 | TASK [get_hash : discover the hashes url ( non-component )]
2020-06-28 12:29:37.949464 | primary | ERROR
2020-06-28 12:29:37.949926 | primary | {
2020-06-28 12:29:37.950010 | primary | "msg": "The conditional check 'release is search(\"queens|rocky|stein|train\")' failed. The error was: Unexpected templating type error occurred on ({% if release is search(\"queens|rocky|stein|train\") %} True {% else %} False {% endif %}): expected string or bytes-like object\n\nThe error appears to be in '/var/lib/zuul/builds/9e61aae73db9457baf2517f237c50c02/trusted/project_7/review.rdoproject.org/rdo-infra/ci-config/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml': line 8, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n# commit/distro hashes for the combined repo (legacy shared hash for a single repo)\n- name: discover the hashes url ( non-component )\n ^ here\n"
2020-06-28 12:29:37.950078 | primary | }
~~~

These are faily new jobs added here[0]

Following jobs are failing:-

Logs at [1]
periodic-tripleo-ceph-integration-centos-8-scenario001-standalone
periodic-tripleo-ceph-integration-centos-8-scenario001-standalone-train
periodic-tripleo-ceph-integration-centos-8-scenario001-standalone-ussuri

Logs at [2]
periodic-tripleo-ceph-integration-centos-8-scenario004-standalone
periodic-tripleo-ceph-integration-centos-8-scenario004-standalone-train
periodic-tripleo-ceph-integration-centos-8-scenario004-standalone-ussuri

Logs at [3]
periodic-tripleo-ceph-ansible-integration-centos-8-scenario001-standalone
periodic-tripleo-ceph-ansible-integration-centos-8-scenario001-standalone-train
periodic-tripleo-ceph-ansible-integration-centos-8-scenario001-standalone-ussuri

Logs at [4]
periodic-tripleo-ceph-ansible-integration-centos-8-scenario004-standalone
periodic-tripleo-ceph-ansible-integration-centos-8-scenario004-standalone-train
periodic-tripleo-ceph-ansible-integration-centos-8-scenario004-standalone-ussuri

Tried Adding release in test patch[5] - with additonal relase it passes the ^^ above failed step but later failed with error[6]:-

[0] https://review.rdoproject.org/r/#/c/26647/

[1]
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-integration-centos-8-scenario001-standalone/bba96a1/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-integration-centos-8-scenario001-standalone-train/bbb00ca/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-integration-centos-8-scenario001-standalone-ussuri/463e557/job-output.txt

[2]
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-integration-centos-8-scenario004-standalone/8dc4007/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-integration-centos-8-scenario004-standalone-train/9e61aae/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-integration-centos-8-scenario004-standalone-ussuri/3097819/job-output.txt

[3]
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-ansible-integration-centos-8-scenario001-standalone/6ceba36/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-ansible-integration-centos-8-scenario001-standalone-train/9ceed77/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-ansible-integration-centos-8-scenario001-standalone-ussuri/f801af0/job-output.txt

[4]
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-ansible-integration-centos-8-scenario004-standalone/74e47f8/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-ansible-integration-centos-8-scenario004-standalone-train/361b98e/job-output.txt
https://logserver.rdoproject.org/openstack-periodic-weekend/github.com/ceph/ceph-ansible/master/periodic-tripleo-ceph-ansible-integration-centos-8-scenario004-standalone-ussuri/c926a7f/job-output.txt

[5]
https://review.rdoproject.org/r/#/c/27463/12/zuul.yaml

~~~
- project:
    check:
      jobs:
        - periodic-tripleo-ceph-integration-centos-8-scenario004-standalone-train:
            vars:
              force_periodic: true
              release: train >>>>>>>>
~~~

[6]

https://logserver.rdoproject.org/63/27463/12/check/periodic-tripleo-ceph-integration-centos-8-scenario004-standalone-train/622e738/job-output.txt

~~~
2020-06-30 14:43:22.356470 | TASK [run-test : Generate role variable file]
2020-06-30 14:43:22.974401 | primary | ERROR
2020-06-30 14:43:22.974835 | primary | {
2020-06-30 14:43:22.974922 | primary | "msg": "AnsibleUndefinedVariable: 'buildset_artifacts_url' is undefined"
2020-06-30 14:43:22.975059 | primary | }
2020-06-30 14:43:22.996292 |
~~~

[Sandeep Yadav (sandeepyadav93)]

Hi,

Patch - https://review.rdoproject.org/r/#/c/28318/ is in progress.

[Sandeep Yadav (sandeepyadav93)]

Patch: https://review.rdoproject.org/r/#/c/28318/ fixed this bug.

Test patch: https://review.rdoproject.org/r/#/c/27463/15/zuul.yaml

https://logserver.rdoproject.org/18/28318/2/check/tripleo-ceph-integration-centos-8-scenario001-standalone-train/adb4847/job-output.txt -> we have passed the failure which is reported in this bug.