Activity log for bug #1580817

Date Who What changed Old value New value Message
2016-05-12 00:02:50 Andres Rodriguez bug added bug
2016-05-12 00:03:29 Andres Rodriguez description ==> /var/log/maas/rackd.log <== 2016-05-12 08:00:22+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '192.168.20.104', 57846) PEER:IPv4Address(T CP, '192.168.20.104', 5252)) 2016-05-12 08:00:22+0800 [ClusterClient,client] Querying node power states. Traceback (most recent call last): File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 434, in errback self._startRunCallbacks(fail) File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 501, in _startRunCallbacks self._runCallbacks() File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 588, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1184, in gotResult _inlineCallbacks(r, g, deferred) --- <exception caught here> --- File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1126, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/usr/lib/python3/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/usr/lib/python3/dist-packages/provisioningserver/pserv_services/node_power_monitor_service.py", line 64, in query_nodes ListNodePowerParameters, uuid=client.localIdent) twisted.internet.error.ConnectionDone: Connection was closed cleanly. ==> /var/log/maas/maas.log <== May 12 08:00:22 trusty-maas9 maas.power_monitor_service: [ERROR] Failed to query nodes' power status: Connection was closed cleanly. 1. updated the ephemeral image repo to use daily 2. maas webui lagged for a sec. 3. controller status showed yellow (warning) 4. saw this error. I don't really know whether this can be reproduced actively. ==> /var/log/maas/rackd.log <== 2016-05-12 08:00:22+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '192.168.20.104', 57846) PEER:IPv4Address(T CP, '192.168.20.104', 5252)) 2016-05-12 08:00:22+0800 [ClusterClient,client] Querying node power states.         Traceback (most recent call last):           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 434, in errback             self._startRunCallbacks(fail)           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 501, in _startRunCallbacks             self._runCallbacks()           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 588, in _runCallbacks             current.result = callback(current.result, *args, **kw)           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1184, in gotResult             _inlineCallbacks(r, g, deferred)         --- <exception caught here> ---           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1126, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python3/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python3/dist-packages/provisioningserver/pserv_services/node_power_monitor_service.py", line 64, in query_nodes             ListNodePowerParameters, uuid=client.localIdent)         twisted.internet.error.ConnectionDone: Connection was closed cleanly. ==> /var/log/maas/maas.log <== May 12 08:00:22 trusty-maas9 maas.power_monitor_service: [ERROR] Failed to query nodes' power status: Connection was closed cleanly.
2016-05-12 00:03:32 Andres Rodriguez maas: milestone 2.1.0
2016-05-12 00:03:33 Andres Rodriguez maas: milestone 2.1.0 2.0.0
2016-05-12 00:03:35 Andres Rodriguez maas: importance Undecided Critical
2016-05-12 00:06:31 Andres Rodriguez description 1. updated the ephemeral image repo to use daily 2. maas webui lagged for a sec. 3. controller status showed yellow (warning) 4. saw this error. I don't really know whether this can be reproduced actively. ==> /var/log/maas/rackd.log <== 2016-05-12 08:00:22+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '192.168.20.104', 57846) PEER:IPv4Address(T CP, '192.168.20.104', 5252)) 2016-05-12 08:00:22+0800 [ClusterClient,client] Querying node power states.         Traceback (most recent call last):           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 434, in errback             self._startRunCallbacks(fail)           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 501, in _startRunCallbacks             self._runCallbacks()           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 588, in _runCallbacks             current.result = callback(current.result, *args, **kw)           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1184, in gotResult             _inlineCallbacks(r, g, deferred)         --- <exception caught here> ---           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1126, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python3/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python3/dist-packages/provisioningserver/pserv_services/node_power_monitor_service.py", line 64, in query_nodes             ListNodePowerParameters, uuid=client.localIdent)         twisted.internet.error.ConnectionDone: Connection was closed cleanly. ==> /var/log/maas/maas.log <== May 12 08:00:22 trusty-maas9 maas.power_monitor_service: [ERROR] Failed to query nodes' power status: Connection was closed cleanly. 1. updated the ephemeral image repo to use daily 2. maas webui lagged for a sec. 3. controller status showed yellow (warning) 4. saw this error. I don't know whether this is reproduceable. ==> /var/log/maas/rackd.log <== 2016-05-12 08:00:22+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '192.168.20.104', 57846) PEER:IPv4Address(T CP, '192.168.20.104', 5252)) 2016-05-12 08:00:22+0800 [ClusterClient,client] Querying node power states.         Traceback (most recent call last):           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 434, in errback             self._startRunCallbacks(fail)           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 501, in _startRunCallbacks             self._runCallbacks()           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 588, in _runCallbacks             current.result = callback(current.result, *args, **kw)           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1184, in gotResult             _inlineCallbacks(r, g, deferred)         --- <exception caught here> ---           File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1126, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python3/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python3/dist-packages/provisioningserver/pserv_services/node_power_monitor_service.py", line 64, in query_nodes             ListNodePowerParameters, uuid=client.localIdent)         twisted.internet.error.ConnectionDone: Connection was closed cleanly. ==> /var/log/maas/maas.log <== May 12 08:00:22 trusty-maas9 maas.power_monitor_service: [ERROR] Failed to query nodes' power status: Connection was closed cleanly.
2016-05-12 00:09:34 Andres Rodriguez summary twisted.internet.error.ConnectionDone: Connection was closed cleanly. [2.0b4] twisted.internet.error.ConnectionDone: Connection was closed cleanly.
2016-05-12 06:39:22 Lee Trager maas: status New Invalid
2016-05-12 11:49:12 Andres Rodriguez maas: status Invalid Incomplete
2016-05-31 17:39:42 Gavin Panella maas: status Incomplete In Progress
2016-05-31 17:39:46 Gavin Panella maas: importance Critical Medium
2016-05-31 17:40:00 Gavin Panella maas: assignee Gavin Panella (allenap)
2016-05-31 17:43:06 Launchpad Janitor branch linked lp:~allenap/maas/power-monitor-better-error-message--bug-1580817
2016-05-31 19:44:46 MAAS Lander maas: status In Progress Fix Committed
2016-08-18 11:27:19 Andres Rodriguez maas: status Fix Committed Fix Released