Comment 2 for bug 1649252

Revision history for this message
Ben Nemec (bnemec) wrote : Re: CI: OVB jobs are failing in CI

Basically all of our compute nodes just went down too:

+----+--------------------------------------+-------+----------+
| ID | Hypervisor hostname | State | Status |
+----+--------------------------------------+-------+----------+
| 1 | overcloud-novacompute-28.localdomain | down | enabled |
| 2 | overcloud-novacompute-29.localdomain | down | enabled |
| 3 | overcloud-novacompute-30.localdomain | down | enabled |
| 4 | overcloud-novacompute-26.localdomain | down | enabled |
| 5 | overcloud-novacompute-6.localdomain | down | enabled |
| 6 | overcloud-novacompute-27.localdomain | down | enabled |
| 7 | overcloud-novacompute-10.localdomain | down | enabled |
| 8 | overcloud-novacompute-31.localdomain | down | enabled |
| 9 | overcloud-novacompute-1.localdomain | down | disabled |
| 10 | overcloud-novacompute-9.localdomain | down | enabled |
| 11 | overcloud-novacompute-4.localdomain | down | enabled |
| 12 | overcloud-novacompute-14.localdomain | down | disabled |
| 13 | overcloud-novacompute-19.localdomain | down | enabled |
| 14 | overcloud-novacompute-5.localdomain | down | enabled |
| 15 | overcloud-novacompute-17.localdomain | down | disabled |
| 16 | overcloud-novacompute-22.localdomain | down | enabled |
| 17 | overcloud-novacompute-7.localdomain | down | enabled |
| 18 | overcloud-novacompute-8.localdomain | up | enabled |
| 19 | overcloud-novacompute-0.localdomain | down | enabled |
| 20 | overcloud-novacompute-3.localdomain | down | enabled |
| 21 | overcloud-novacompute-23.localdomain | down | enabled |
| 22 | overcloud-novacompute-21.localdomain | down | enabled |
| 23 | overcloud-novacompute-25.localdomain | down | enabled |
| 24 | overcloud-novacompute-32.localdomain | down | enabled |
| 25 | overcloud-novacompute-18.localdomain | down | enabled |
| 26 | overcloud-novacompute-20.localdomain | down | enabled |
| 27 | overcloud-novacompute-11.localdomain | down | enabled |
| 28 | overcloud-novacompute-15.localdomain | down | enabled |
| 29 | overcloud-novacompute-2.localdomain | down | disabled |
| 30 | overcloud-novacompute-12.localdomain | down | enabled |
| 31 | overcloud-novacompute-13.localdomain | down | enabled |
| 32 | overcloud-novacompute-16.localdomain | down | enabled |
| 33 | overcloud-novacompute-24.localdomain | down | enabled |
+----+--------------------------------------+-------+----------+

And I can't get on them anymore:

[bnemec@RedHat ~]$ ssh -i rh1id xxx.xxx.xxx.72
ssh_exchange_identification: Connection closed by remote host

I'm going to start bouncing them in ironic since there's really nothing more I can do to debug this.