Comment 5 for bug 1326364

Revision history for this message
aeva black (tenbrae) wrote :

Confirmed this on the TripleO hp1 test cluster just now -- it's got 3 ERROR/DELETING instances and 6 stuck nodes:

(undercloud)stack@bm-aw1az2-freecloud0001:/var/log/upstart$ ironic node-list | grep bb59bea5-166a-4023-a122-ee793d21ccd2
| 9b9e8326-2fea-4aa9-820d-2003b262000e | bb59bea5-166a-4023-a122-ee793d21ccd2 | power on | deploy failed | False |
| a5318eae-3d81-4d62-9531-e5700c71e378 | bb59bea5-166a-4023-a122-ee793d21ccd2 | power on | deploy failed | False |

(undercloud)stack@bm-aw1az2-freecloud0001:/var/log/upstart$ ironic node-list | grep 1cb064ee-3eff-4799-a489-bd4f447f285c
| 33ad2330-6bd9-4413-8955-50db3a55e537 | 1cb064ee-3eff-4799-a489-bd4f447f285c | power on | deploy failed | False |
| b2b93c39-59e9-46f9-9e1e-d3764b2b0ec8 | 1cb064ee-3eff-4799-a489-bd4f447f285c | power on | deploy failed | False |

(undercloud)stack@bm-aw1az2-freecloud0001:/var/log/upstart$ ironic node-list | grep 9df33a91-4be3-429c-a712-35cd60a1e101
| 01c3663f-31a2-4bfa-9b1b-2d8953fb1c86 | 9df33a91-4be3-429c-a712-35cd60a1e101 | power on | deploy failed | False |
| 3f9df53e-5a76-47b3-a1c4-f596822bb43d | 9df33a91-4be3-429c-a712-35cd60a1e101 | None | deploy failed | True |

The last node (3f9df53e-5a76-47b3-a1c4-f596822bb43d) seems to have had a hardware fault, but the other two are clearly repeating the same error.

Logs from the first one here:

http://paste.openstack.org/show/wOdHiJurWONIhlYrejCj/