Comment 1 for bug 1291323

Revision history for this message
Derek Higgins (derekh) wrote :

One of the test-env nodes(testenv-testenv8-v6ci3v2kefqm) doesn't seem to be responding

I got ssh'd in but virsh list didn't return and couldn't be killed, now having trouble sshing in.

While I was in the load was
top - 12:26:24 up 16 days, 12:28, 2 users, load average: 11.89, 11.52, 10.81
Tasks: 467 total, 1 running, 410 sleeping, 0 stopped, 56 zombie
%Cpu(s): 1.3 us, 0.3 sy, 0.0 ni, 97.5 id, 0.8 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem: 98996644 total, 89473708 used, 9522936 free, 72776 buffers
KiB Swap: 0 total, 0 used, 0 free, 65427132 cached

nothing mad there, but things seemed to be running slow (possibly just the ssh connection)

There was also about 20 ci_commans stuck doing virsh destorys, the earliest ones I can see are
root 11406 11163 0 00:41 ? 00:00:00 /usr/bin/python /usr/local/bin/ci_commands
root 11407 1 0 00:41 ? 00:00:00 /usr/bin/python /usr/local/bin/ci_commands
root 11667 11615 0 00:45 ? 00:00:00 /usr/bin/python /usr/local/bin/ci_commands
root 11722 1 0 00:46 ? 00:00:00 /usr/bin/python /usr/local/bin/ci_commands