MAAS

Cluster disconnecting periodically - [ClusterClient,client] Failed to refresh power state

Bug #1475445 reported by Larry Michel on 2015-07-16

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	MAAS	Fix Released	Critical	Gavin Panella	MAAS 1.9.0

Bug Description

We're seeing issues with cluster disconnecting periodically..

From regiond.log:

ubuntu@maas-trusty-back-may22:/var/log/maas$ grep "Unable to get RPC connection for cluster" regiond.log
2015-07-16 22:03:46 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:07:14 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:07:16 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:07:18 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:07:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
.. .. repeats multiple times
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)
2015-07-16 22:19:20 [maasserver] ERROR: Unable to get RPC connection for cluster 'OIL Cluster' (037c960b-5b9f-4701-8366-eeda2c09d14e)

From clusterd.log:

2015-07-16 22:03:27+0000 [-] donphan: Power could not be turned off; timed out.
2015-07-16 22:03:45+0000 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 60788) PEER:IPv4Address(TCP, u'127.0.0.1', 5251))
2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Unhandled failure dispatching AMP command. This is probably a bug. Please ensure that this error is handled within application code or declared in the signature of the PowerQuery command. [maas-trusty-back-may22:pid=10787:cmd=PowerQuery:ask=17c04]
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Failed to refresh power state.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Failed to refresh power state.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
        Traceback (most recent call last):
        Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.
2015-07-16 22:03:27+0000 [-] donphan: Power could not be turned off; timed out.
2015-07-16 22:03:45+0000 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 60788) PEER:IPv4Address(TCP, u'127.0.0.1', 5251))
2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
        Traceback (most recent call last):
        Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Failed to refresh power state.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Failed to refresh power state.
Traceback (most recent call last):
Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:45+0000 [ClusterClient,client] Logging TFTP request failed.
        Traceback (most recent call last):
        Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.
        Traceback (most recent call last):
        Failure: twisted.internet.error.ConnectionDone: Connection was closed cleanly.

2015-07-16 22:03:53+0000 [TFTP (UDP)] Datagram received from ('10.245.0.152', 1024): <RRQDatagram(filename=pxelinux.0, mode=octet, options={'blksize': '1432', 'tsize': '0'})>

Tags:

Revision history for this message

Larry Michel (lmic) wrote on 2015-07-16:

logs.tar.gz Edit (1.4 MiB, application/x-tar)

Revision history for this message

Larry Michel (lmic) wrote on 2015-07-27:

We've recreated this issue this morning.

Revision history for this message

Larry Michel (lmic) wrote on 2015-07-27:

newlogs.tar.gz Edit (3.3 MiB, application/x-tar)

logs from this morning's recreate.

Andres Rodriguez (andreserl) on 2015-07-29

Changed in maas:
assignee:	nobody → Gavin Panella (allenap)
importance:	Undecided → Critical

Andres Rodriguez (andreserl) on 2015-07-31

Changed in maas:
status:	New → Triaged
milestone:	none → 1.9.0

Revision history for this message

Gavin Panella (allenap) wrote on 2015-07-31:

Can you check for stray regiond processes?

Changed in maas:
status:	Triaged → Incomplete

Revision history for this message

Larry Michel (lmic) wrote on 2015-07-31:

Download full text (12.2 KiB)

Gavin, here's a list of processes. Any specific command you'd like us to run to get more info on what's running?

ubuntu@maas-trusty-back-may22:~$ ps -efaux
STAT START TIME COMMAND
Ss Jun23 3:17 /sbin/init
S Jun23 0:00 upstart-udev-bridge --daemon
Ss Jun23 0:00 /lib/systemd/systemd-udevd --daemon
Ss Jun23 0:03 rpcbind
Ss Jun23 0:00 dbus-daemon --system --fork
Ss Jun23 0:00 /lib/systemd/systemd-logind
Ss+ Jun23 0:00 /sbin/getty -8 38400 tty4
Ss+ Jun23 0:00 /sbin/getty -8 38400 tty2
Ss+ Jun23 0:00 /sbin/getty -8 38400 tty3
Ss Jun23 0:00 /usr/sbin/sshd -D
Ss Jul28 0:00 \_ sshd: ubuntu [priv]
S Jul28 0:00 | \_ sshd: ubuntu@pts/2
Ss+ Jul28 0:00 | \_ -bash LANG=en_GB.UTF-8 USER=ubuntu LOGNAME=ubuntu HOME=/home/ubuntu PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games MAIL=/var/mail/ubuntu SHELL=/bin/bash SSH_CLIENT=10.172.68.84 60285 22 SSH_CONNECTION=10.172.68.84 60285 10.245.0.10 22 SSH_TTY=/dev/pts/2 TERM=xterm
Ss Jul30 0:00 \_ sshd: ubuntu [priv]
S Jul30 0:00 | \_ sshd: ubuntu
Ss 14:50 0:00 \_ sshd: ubuntu [priv]
S 14:50 0:00 \_ sshd: ubuntu@pts/6
Ss 14:50 0:00 \_ -bash LANG=en_GB.UTF-8 USER=ubuntu LOGNAME=ubuntu HOME=/home/ubuntu PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games MAIL=/var/mail/ubuntu SHELL=/bin/bash SSH_CLIENT=10.172.68.84 34814 22 SSH_CONNECTION=10.172.68.84 34814 10.245.0.10 22 SSH_TTY=/dev/pts/6 TERM=xterm
R+ 14:54 0:00 \_ ps -efaux VIRTUALENVWRAPPER_SCRIPT=/usr/share/virtualenvwrapper/virtualenvwrapper.sh TERM=xterm-256color SHELL=/bin/bash SSH_CLIENT=10.172.68.84 34814 22 SSH_TTY=/dev/pts/6 USER=ubuntu LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma
Ss Jun23 1:24 cron
Ss Jun23 0:00 atd
Ssl Jun23 756:04 tgtd
...

Gavin, here's a list of processes. Any specific command you'd like us to run to get more info on what's running?

ubuntu@maas-trusty-back-may22:~$ ps -efaux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0  33776  2420 ?        Ss   Jun23   3:17 /sbin/init
root       236  0.0  0.0  19472   536 ?        S    Jun23   0:00 upstart-udev-bridge --daemon
root       267  0.0  0.0  49268   836 ?        Ss   Jun23   0:00 /lib/systemd/systemd-udevd --daemon
root       388  0.0  0.0  23416   584 ?        Ss   Jun23   0:03 rpcbind
message+   398  0.0  0.0  39320   940 ?        Ss   Jun23   0:00 dbus-daemon --system --fork
root       516  0.0  0.0  43448  1332 ?        Ss   Jun23   0:00 /lib/systemd/systemd-logind
root       534  0.0  0.0  12784   668 ?        Ss+  Jun23   0:00 /sbin/getty -8 38400 tty4
root       544  0.0  0.0  12784   668 pts/4    Ss+  Jun23   0:00 /sbin/getty -8 38400 tty2
root       545  0.0  0.0  12784   668 pts/7    Ss+  Jun23   0:00 /sbin/getty -8 38400 tty3
root       573  0.0  0.0  61364  1228 ?        Ss   Jun23   0:00 /usr/sbin/sshd -D
root     46681  0.0  0.0 105628  3396 ?        Ss   Jul28   0:00  \_ sshd: ubuntu [priv] 
ubuntu   46738  0.0  0.0 105628  1312 ?        S    Jul28   0:00  |   \_ sshd: ubuntu@pts/2  
ubuntu   46739  0.0  0.0  22956  2020 pts/2    Ss+  Jul28   0:00  |       \_ -bash LANG=en_GB.UTF-8 USER=ubuntu LOGNAME=ubuntu HOME=/home/ubuntu PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games MAIL=/var/mail/ubuntu SHELL=/bin/bash SSH_CLIENT=10.172.68.84 60285 22 SSH_CONNECTION=10.172.68.84 60285 10.245.0.10 22 SSH_TTY=/dev/pts/2 TERM=xterm
root     63532  0.0  0.0 105628  3728 ?        Ss   Jul30   0:00  \_ sshd: ubuntu [priv] 
ubuntu   63707  0.0  0.0 105628  1436 ?        S    Jul30   0:00  |   \_ sshd: ubuntu        
root     17307  0.0  0.0 105628  4244 ?        Ss   14:50   0:00  \_ sshd: ubuntu [priv] 
ubuntu   17371  0.0  0.0 105628  1904 ?        S    14:50   0:00      \_ sshd: ubuntu@pts/6  
ubuntu   17372  0.0  0.0  22948  4108 pts/6    Ss   14:50   0:00          \_ -bash LANG=en_GB.UTF-8 USER=ubuntu LOGNAME=ubuntu HOME=/home/ubuntu PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games MAIL=/var/mail/ubuntu SHELL=/bin/bash SSH_CLIENT=10.172.68.84 34814 22 SSH_CONNECTION=10.172.68.84 34814 10.245.0.10 22 SSH_TTY=/dev/pts/6 TERM=xterm
ubuntu   20517  0.0  0.0  18580  1328 pts/6    R+   14:54   0:00              \_ ps -efaux VIRTUALENVWRAPPER_SCRIPT=/usr/share/virtualenvwrapper/virtualenvwrapper.sh TERM=xterm-256color SHELL=/bin/bash SSH_CLIENT=10.172.68.84 34814 22 SSH_TTY=/dev/pts/6 USER=ubuntu LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma
root       588  0.0  0.0  23652   868 ?        Ss   Jun23   1:24 cron
daemon     590  0.0  0.0  19136    20 ?        Ss   Jun23   0:00 atd
root       652  1.3  0.2 10364748 22432 ?      Ssl  Jun23 756:04 tgtd
root       665  0.0  0.0  13124   264 ?        S    Jun23   0:53  \_ tgtd
root       678  0.0  0.0  15804   536 ?        S    Jun23   0:00 upstart-socket-bridge --daemon
root       688  0.0  0.0  15824   456 ?        S    Jun23   0:00 upstart-file-bridge --daemon
nagios    2636  0.0  0.0  23328   588 ?        Ss   Jun23   0:00 /usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -d
root      3019  0.0  0.1  82336 14936 ?        S    Jun23  34:28 /usr/bin/python /usr/bin/landscape-client --daemon --pid-file /var/run/landscape/landscape-client.pid
landsca+  3022  0.0  0.2 379756 20772 ?        SNl  Jun23  17:37  \_ /usr/bin/python /usr/bin/landscape-broker --ignore-sigint --quiet
landsca+  3024  0.0  0.3 115104 29856 ?        SN   Jun23  22:45  \_ /usr/bin/python /usr/bin/landscape-monitor --ignore-sigint --quiet
root      3027  0.0  0.2 101484 16972 ?        S    Jun23  12:02  \_ /usr/bin/python /usr/bin/landscape-manager --ignore-sigint --quiet
root      3157  0.0  0.0  12784   664 ?        Ss+  Jun23   0:00 /sbin/getty -8 38400 console
root      3159  0.0  0.0  12784   668 pts/1    Ss+  Jun23   0:00 /sbin/getty -8 38400 tty1
ubuntu   50326  0.0  0.0  33824   968 ?        SNs  Jun24  20:31 tmux -2 -f /usr/share/byobu/profiles/tmuxrc new-session -n - /usr/bin/byobu-shell LESSOPEN=| /usr/bin/lesspipe %s BYOBU_LIGHT=\#EEEEEE BYOBU_SED=sed MAIL=/var/mail/ubuntu SSH_CLIENT=10.172.194.252 54964 22 USER=ubuntu LC_TIME=en_US.UTF-8 SHLVL=1 HOME=/home/ubuntu BYOBU_TIME=%H:%M:%S SSH_TTY=/dev/pts/2 BYOBU_PREFIX=/usr LC_MONETARY=en_US.UTF-8 BYOBU_WINDOW_NAME=- LOGNAME=ubuntu BYOBU_ULIMIT=ulimit _=/usr/bin/byobu BYOBU_READLINK=
ubuntu   50332  0.0  0.0  23020   780 pts/3    Ss   Jun24   0:00  \_ /bin/bash LESSOPEN=| /usr/bin/lesspipe %s TMUX=/tmp/tmux-1000/default,50326,1 BYOBU_SED=sed BYOBU_LIGHT=\#EEEEEE MAIL=/var/mail/ubuntu SSH_CLIENT=10.172.194.252 54964 22 USER=ubuntu LC_TIME=en_US.UTF-8 SHLVL=2 HOME=/home/ubuntu BYOBU_TIME=%H:%M:%S SSH_TTY=/dev/pts/2 BYOBU_PREFIX=/usr LC_MONETARY=en_US.UTF-8 BYOBU_WINDOW_NAME=- BYOBU_ULIMIT=ulimit LOGNAME=ubuntu BYOBU_READLINK=readlink BYOBU_DISTRO=Ubuntu _=/usr/bin/byobu-she
root     50430  0.0  0.0  67304  1164 pts/3    S    Jun24   0:00  |   \_ sudo su
root     50469  0.0  0.0  66628  1088 pts/3    S    Jun24   0:00  |       \_ su
root     50470  0.0  0.0  21284   784 pts/3    S    Jun24   0:00  |           \_ bash
root     60323  0.0  0.0 127504   892 pts/3    S+   Jun29   0:00  |               \_ vim regiond.log.2.gz
ubuntu   51533  0.0  0.0  23020   780 pts/4    Ss   Jun24   0:00  \_ /bin/bash LC_PAPER=en_US.UTF-8 LC_ADDRESS=en_US.UTF-8 VIRTUALENVWRAPPER_SCRIPT=/usr/share/virtualenvwrapper/virtualenvwrapper.sh LC_MONETARY=en_US.UTF-8 TERM=screen SHELL=/bin/bash SSH_CLIENT=10.172.194.252 54964 22 BYOBU_CONFIG_DIR=/home/ubuntu/.byobu LC_NUMERIC=en_US.UTF-8 BYOBU_TTY=/dev/pts/2 SSH_TTY=/dev/pts/2 BYOBU_READLINK=readlink USER=ubuntu LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;0
root     51578  0.0  0.0  67304  1164 pts/4    S    Jun24   0:00      \_ sudo su
root     51604  0.0  0.0  66628  1088 pts/4    S    Jun24   0:00          \_ su
root     51605  0.0  0.0  21292   764 pts/4    S+   Jun24   0:00              \_ bash
proxy     8356  0.8  7.2 698560 588104 ?       SNsl Jun24 459:59 /usr/sbin/squid3 -N -f /etc/maas/maas-proxy.conf
proxy    63766  0.0  0.0  12792   984 ?        SNs  06:51   0:00  \_ (pinger)
syslog    8520  0.0  0.7 343760 59336 ?        SNsl Jun24  11:18 rsyslogd
postgres  8980  0.2  0.1 247776  9644 ?        SN   Jun24 109:22 /usr/lib/postgresql/9.3/bin/postgres -D /var/lib/postgresql/9.3/main -c config_file=/etc/postgresql/9.3/main/postgresql.conf
postgres  8982  0.0  1.7 248116 139068 ?       SNs  Jun24   9:35  \_ postgres: checkpointer process                                                                                              
postgres  8983  0.0  1.4 247776 119196 ?       Ss   Jun24   0:23  \_ postgres: writer process                                                                                                    
postgres  8984  0.0  0.0 247776  4736 ?        SNs  Jun24   3:54  \_ postgres: wal writer process                                                                                                
postgres  8985  0.0  0.0 248636  1548 ?        Ss   Jun24   0:41  \_ postgres: autovacuum launcher process                                                                                       
postgres  8986  0.0  0.0 103732   708 ?        SNs  Jun24  30:37  \_ postgres: stats collector process                                                                                           
postgres 53592  0.0  0.0 249016  3780 ?        SNs  Jul27   0:28  \_ postgres: maas maasdb 127.0.0.1(50671) idle                                                                                 
postgres 53637  0.0  0.0 249016  3800 ?        SNs  Jul27   0:26  \_ postgres: maas maasdb 127.0.0.1(50701) idle                                                                                 
postgres 53667  0.0  0.0 249016  3792 ?        SNs  Jul27   0:24  \_ postgres: maas maasdb 127.0.0.1(50723) idle                                                                                 
postgres 53677  0.0  0.0 249016  3784 ?        SNs  Jul27   0:22  \_ postgres: maas maasdb 127.0.0.1(50725) idle                                                                                 
bind      9610  0.5  1.1 694072 93816 ?        SNsl Jun24 315:35 /usr/sbin/named -u bind
root     10151  0.0  0.0  92724  1904 ?        Ss   Jun24   1:12 /usr/sbin/apache2 -k start
www-data  1282  0.0  0.0 2024084 5892 ?        SNl  Jul26   3:12  \_ /usr/sbin/apache2 -k start
www-data  1283  0.0  0.0 2024324 5932 ?        SNl  Jul26   2:52  \_ /usr/sbin/apache2 -k start
www-data 41549  0.0  0.0 2023700 5712 ?        SNl  Jul26   3:08  \_ /usr/sbin/apache2 -k start
dhcpd     8651  0.0  0.1  35412 13572 ?        SNs  Jul22   2:24 /usr/sbin/dhcpd -user dhcpd -group dhcpd -f -q -4 -pf /run/maas/dhcp/dhcpd.pid -cf /etc/maas/dhcpd.conf -lf /var/lib/maas/dhcp/dhcpd.leases eth0
maas     53396  3.6  2.5 2272732 203584 ?      SNsl Jul27 211:29 /usr/bin/python /usr/bin/twistd --nodaemon --pidfile= maas-regiond --introspect=unix:/tmp/maas-introspect1:lockfile=0
maas     53399  3.1  2.3 2425844 192776 ?      SNsl Jul27 179:04 /usr/bin/python /usr/bin/twistd --nodaemon --pidfile= maas-regiond --introspect=unix:/tmp/maas-introspect2:lockfile=0
maas     53402  6.0  2.4 2422320 195840 ?      SNsl Jul27 350:49 /usr/bin/python /usr/bin/twistd --nodaemon --pidfile= maas-regiond --introspect=unix:/tmp/maas-introspect3:lockfile=0
maas     53405  7.3  2.4 2274044 196052 ?      SNsl Jul27 421:58 /usr/bin/python /usr/bin/twistd --nodaemon --pidfile= maas-regiond --introspect=unix:/tmp/maas-introspect4:lockfile=0
maas     53681 10.0 11.1 2141780 910512 ?      SNsl Jul27 582:01 /usr/bin/python /usr/bin/twistd --nodaemon --uid=maas --gid=maas --pidfile= maas-clusterd --config-file=/etc/maas/pserv.yaml
maas     19693  100 13.5 2307964 1104832 ?     R    14:54   0:10  \_ /usr/bin/python /usr/bin/twistd --nodaemon --uid=maas --gid=maas --pidfile= maas-clusterd --config-file=/etc/maas/pserv.yaml
maas     20349  0.5  0.0   8560   676 ?        S    14:54   0:00  \_ /bin/sh
maas     20352  0.0  0.0   8560   128 ?        S    14:54   0:00  |   \_ /bin/sh
maas     20354  0.0  0.0  28016  3780 ?        S    14:54   0:00  |       \_ /usr/sbin/ipmipower -W opensesspriv --driver-type=LAN_2_0 -h 192.168.224.71 -u      -p              --stat
maas     20412  1.0  0.0   8560   676 ?        S    14:54   0:00  \_ /bin/sh
maas     20416 11.0  0.2  85460 22812 ?        S    14:54   0:00  |   \_ python -
maas     20421  1.5  0.0   8560   676 ?        SN   14:54   0:00  \_ /bin/sh
maas     20433 20.0  0.2  85460 22808 ?        SN   14:54   0:00  |   \_ python -
maas     20460  2.0  0.0   8560   676 ?        S    14:54   0:00  \_ /bin/sh
maas     20461 16.0  0.2 105140 23836 ?        S    14:54   0:00  |   \_ python -
maas     20467  1.0  0.0 173100  4284 pts/8    Ssl+ 14:54   0:00  |       \_ /usr/bin/virsh --connect qemu+ssh://ubuntu@10.245.0.161/system
maas     20469  0.0  0.0  46200  2976 pts/8    S+   14:54   0:00  |           \_ ssh -l ubuntu 10.245.0.161 sh -c 'if 'nc' -q 2>&1 | grep "requires an argument" >/dev/null 2>&1; then ARG=-q0;else ARG=;fi;'nc' $ARG -U /var/run/libvirt/libvirt-sock'
maas     20489  2.0  0.0   8560   672 ?        S    14:54   0:00  \_ /bin/sh
maas     20492 17.0  0.2  85460 22812 ?        S    14:54   0:00  |   \_ python -
maas     20491  3.0  0.0   8560   676 ?        S    14:54   0:00  \_ /bin/sh
maas     20494 17.0  0.2 105140 23832 ?        S    14:54   0:00  |   \_ python -
maas     20504  0.0  0.0 173100  4284 pts/7    Ssl+ 14:54   0:00  |       \_ /usr/bin/virsh --connect qemu+ssh://ubuntu@10.245.0.161/system
maas     20506  0.0  0.0  46200  2976 pts/7    S+   14:54   0:00  |           \_ ssh -l ubuntu 10.245.0.161 sh -c 'if 'nc' -q 2>&1 | grep "requires an argument" >/dev/null 2>&1; then ARG=-q0;else ARG=;fi;'nc' $ARG -U /var/run/libvirt/libvirt-sock'
maas     20503  2.0  0.0   8560   672 ?        S    14:54   0:00  \_ /bin/sh
maas     20507  0.0  0.2  85460 22812 ?        S    14:54   0:00      \_ python -
ubuntu@maas-trusty-back-may22:~$

Changed in maas:
status:	Incomplete → New

Andres Rodriguez (andreserl) on 2015-08-03

no longer affects:

maas/1.9

Gavin Panella (allenap) on 2015-09-02

Changed in maas:
status:	New → Triaged

Revision history for this message

Blake Rouse (blake-rouse) wrote on 2015-10-08:

The checking of power in 1.9 has been greatly improved to help with concurrency and transactions. This is not something that is able to be backported to 1.8.

no longer affects:	maas/1.8
Changed in maas:
status:	Triaged → Fix Committed

Andres Rodriguez (andreserl) on 2016-01-05

Changed in maas:
status:	Fix Committed → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Bug attachments

Add attachment

Remote bug watches

Bug watches keep track of this bug in other bug trackers.