Comment 14 for bug 1472338

Revision history for this message
Mike Pontillo (mpontillo) wrote : Re: Failed to refresh power state and unhandled errors - exceptions.OSError: [Errno 12] Cannot allocate memory

I talked to Jason earlier today and was able to triage the problem in this environment. So far the most interesting thing I've found is:

top - 00:18:16 up 209 days, 2:23, 6 users, load average: 1.79, 1.41, 1.49
Tasks: 65 total, 1 running, 64 sleeping, 0 stopped, 0 zombie
%Cpu(s): 5.0 us, 1.4 sy, 4.4 ni, 88.6 id, 0.5 wa, 0.0 hi, 0.0 si, 0.0 st
KiB Mem: 8132784 total, 7536812 used, 595972 free, 44424 buffers
KiB Swap: 1998780 total, 1998780 used, 0 free. 1377860 cached Mem

  PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
  319 maas 32 12 2629420 1.347g 2452 S 16.6 17.4 850:58.16 twistd
  436 maas 32 12 3154524 205504 4352 S 13.0 2.5 364:39.89 twistd
  372 maas 32 12 4520152 1.445g 4200 S 1.0 18.6 1026:51 twistd
  418 maas 32 12 5226772 0.984g 4236 S 0.7 12.7 608:09.07 twistd
  398 maas 32 12 2782140 210808 3952 S 0.3 2.6 167:29.80 twistd

I sent a USR2 signal to this process, and found that it was stuck in the DHCP lease parser:

http://paste.ubuntu.com/13684628/

I'm continuing to triage.