Comment 16 for bug 2000226

Revision history for this message
Sandeep Yadav (sandeepyadav93) wrote :

Hello All,

Adding some observations:-

* Issue is transient, some jobs are passing.
* In the affected job as well, Some of the overcloud nodes are provisioning successfully and only ~1/2 out of 4 nodes don't provision successfully.

* Affected jobs have two different symptoms but all the jobs fail on the same task while running growvols.

A) Job fails with Unreachable issue

https://logserver.rdoproject.org/37/28537/62/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-zed/0f4cbc3/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz
~~~
UNREACHABLE | Running /usr/local/sbin/growvols /=8GB /tmp=1GB /var/log=10GB /var/log/audit=2GB /home=1GB /var=100% | overcloud-novacompute-0
~~~

B) Job fails with Failure -

ex. https://logserver.rdoproject.org/37/28537/63/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-zed/7dca9fd/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz

"FATAL | Running /usr/local/sbin/growvols /=8GB /tmp=1GB /var/log=10GB /var/log/audit=2GB /home=1GB /var=50% /srv=50% "

* Rerunning node provisioning on the same nodes passes in 2nd attempt(manually tried)