Jobs fails on stein and older branches with ERROR! the role 'tripleo_validations' was not found

[Sandeep Yadav]

Description:

Stein jobs fails with ERROR! the role 'tripleo_validations' was not found.

Logs:-

https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3e7/773440/1/gate/tripleo-ci-centos-7-standalone/3e78260/job-output.txt

2021-02-05 16:31:32.650118 | primary | +(./toci_quickstart.sh:151): /home/zuul/workspace/.quickstart/bin/ansible-playbook --tags build,standalone --extra-vars @/home/zuul/workspace/.quickstart/config/release/tripleo-ci/CentOS-7/stein.yml --extra-vars @/home/zuul/src/opendev.org/openstack/tripleo-quickstart/config/general_config/featureset-multinode-common.yml --extra-vars @/home/zuul/src/opendev.org/openstack/tripleo-quickstart/config/general_config/featureset052.yml --extra-vars @/home/zuul/src/opendev.org/openstack/tripleo-ci/toci-quickstart/config/testenv/standalone.yml --extra-vars @/home/zuul/workspace/logs/role-vars.yaml -e toci_vxlan_networking=false -e vxlan_networking=false --extra-vars local_working_dir=/home/zuul/workspace/.quickstart --extra-vars virthost=127.0.0.2 --inventory /home/zuul/workspace/.quickstart/hosts --extra-vars tripleo_root=/home/zuul/src/opendev.org/openstack --extra-vars working_dir=/home/zuul --extra-vars tripleo_generate_scripts=true --skip-tags tripleo-validations,teardown-all --extra-vars @/home/zuul/workspace/logs/zuul-variables.yaml --extra-vars @/home/zuul/workspace/logs/hostvars-variables.yaml /home/zuul/workspace/.quickstart/playbooks/multinode-standalone.yml
2021-02-05 16:31:34.051045 | primary | [WARNING]: Found both group and host with same name: undercloud
2021-02-05 16:31:36.705474 | primary | ERROR! the role 'tripleo_validations' was not found in /home/zuul/workspace/.quickstart/playbooks/roles:/home/zuul/src/opendev.org/openstack/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/local/share/opstools-ansible/roles:/home/zuul/workspace/.quickstart/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/share/ansible/roles:/home/zuul/workspace/.quickstart/playbooks
2021-02-05 16:31:36.705625 | primary |
2021-02-05 16:31:36.705896 | primary | The error appears to be in '/home/zuul/workspace/.quickstart/playbooks/multinode-standalone.yml': line 55, column 7, but may
2021-02-05 16:31:36.706058 | primary | be elsewhere in the file depending on the exact syntax problem.
2021-02-05 16:31:36.706109 | primary |
2021-02-05 16:31:36.706212 | primary | The offending line appears to be:
2021-02-05 16:31:36.706261 | primary |
2021-02-05 16:31:36.706321 | primary | roles:
2021-02-05 16:31:36.706462 | primary | - {role: tripleo_validations,
2021-02-05 16:31:36.706547 | primary | ^ here
2021-02-05 16:31:36.783578 | primary | +(./toci_quickstart.sh:162): exit_value=1
2021-02-05 16:31:36.783816 | primary | +(./toci_quickstart.sh:165): [[ 1 == 0 ]]
2021-02-05 16:31:36.783946 | primary | +(./toci_quickstart.sh:166): [[ 1 != 0 ]]
2021-02-05 16:31:36.784154 | primary | +(./toci_quickstart.sh:166): echo 'Playbook run of multinode-standalone.yml failed'
2021-02-05 16:31:36.784293 | primary | Playbook run of multinode-standalone.yml failed
2021-02-05 16:31:36.784605 | primary | +(./toci_quickstart.sh:166): break
2021-02-05 16:31:36.784696 | primary | +(./toci_quickstart.sh:168): [[ 1 == 0 ]]
2021-02-05 16:31:36.784792 | primary | +(./toci_quickstart.sh:168): echo 'Playbook run failed'
2021-02-05 16:31:36.784843 | primary | Playbook run failed
2021-02-05 16:31:36.784939 | primary | +(./toci_quickstart.sh:171): echo 'Quickstart completed.'
2021-02-05 16:31:36.784992 | primary | Quickstart completed.
2021-02-05 16:31:36.785062 | primary | +(./toci_quickstart.sh:172): exit 1
2021-02-05 16:31:37.164858 | primary | ERROR
2021-02-05 16:31:37.165255 | primary | {
2021-02-05 16:31:37.165357 | primary | "delta": "0:05:09.035545",
2021-02-05 16:31:37.165448 | primary | "end": "2021-02-05 16:31:36.786150",
2021-02-05 16:31:37.165536 | primary | "msg": "non-zero return code",
2021-02-05 16:31:37.165624 | primary | "rc": 1,
2021-02-05 16:31:37.165752 | primary | "start": "2021-02-05 16:26:27.750605"
2021-02-05 16:31:37.165842 | primary | }

Looks like started after we merge [1], I don't see this role[2] in the Stein branch which might be causing this issue.

[0] https://review.opendev.org/c/openstack/tripleo-heat-templates/+/773440
[1] https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/755382/34/playbooks/multinode-standalone.yml
[2] https://github.com/openstack/tripleo-validations/tree/stable/stein/roles/tripleo_validations

Possible solutions:-

We probably need to limit the run of that ansible task to train and newer/ backport that role in Stein.

[Sandeep Yadav (sandeepyadav93)]

Issue exists in all branch before train

https://logserver.rdoproject.org/openstack-periodic-integration-stable4-5/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-stein/0320ba9/job-output.txt

~~~
2021-02-07 13:32:29.039359 | primary | ERROR! the role 'tripleo_validations' was not found in /home/zuul/workspace/.quickstart/playbooks/roles:/home/zuul/src/opendev.org/openstack/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/local/share/opstools-ansible/roles:/home/zuul/workspace/.quickstart/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/share/ansible/roles:/home/zuul/workspace/.quickstart/playbooks
2021-02-07 13:32:29.039459 | primary |
2021-02-07 13:32:29.039563 | primary | The error appears to be in '/home/zuul/workspace/.quickstart/playbooks/multinode-standalone.yml': line 55, column 7, but may
2021-02-07 13:32:29.039624 | primary | be elsewhere in the file depending on the exact syntax problem.
~~~

https://logserver.rdoproject.org/openstack-periodic-integration-stable4-5/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-stein/ed4c8c1/job-output.txt

~~~
2021-02-07 13:34:02.855197 | primary | ERROR! the role 'tripleo_validations' was not found in /home/zuul/workspace/.quickstart/playbooks/roles:/home/zuul/src/opendev.org/openstack/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/local/share/opstools-ansible/roles:/home/zuul/workspace/.quickstart/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/share/ansible/roles:/home/zuul/workspace/.quickstart/playbooks
2021-02-07 13:34:02.855269 | primary |
2021-02-07 13:34:02.855314 | primary | The error appears to be in '/home/zuul/workspace/.quickstart/playbooks/multinode-undercloud.yml': line 78, column 7, but may
~~~

https://logserver.rdoproject.org/openstack-periodic-integration-stable6/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-queens/c6d8d59/job-output.txt

~~~
2021-02-06 13:42:08.716193 | primary | ERROR! the role 'tripleo_validations' was not found in /home/zuul/workspace/.quickstart/playbooks/roles:/home/zuul/src/opendev.org/openstack/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/tripleo-quickstart/roles:/home/zuul/workspace/.quickstart/usr/local/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/local/share/opstools-ansible/roles:/home/zuul/workspace/.quickstart/share/ansible/roles:/home/zuul/workspace/.quickstart/usr/share/ansible/roles:/home/zuul/workspace/.quickstart/playbooks
2021-02-06 13:42:08.716291 | primary |
2021-02-06 13:42:08.716360 | primary | The error appears to be in '/home/zuul/workspace/.quickstart/playbooks/baremetal-full-undercloud.yml': line 18, column 7, but may
~~~

[Sandeep Yadav (sandeepyadav93)]

https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/774445

Testing here: https://review.rdoproject.org/r/#/c/28537/

[Sandeep Yadav (sandeepyadav93)]

https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/774445 merged.

Jobs are back to green now.