Activity log for bug #1532262

Date Who What changed Old value New value Message
2016-01-08 16:36:57 Larry Michel bug added bug
2016-01-08 16:37:15 Larry Michel description We upgraded to 1.9.0+bzr4533-0ubuntu1~trusty1 and SM15K system and maas is failing to do power queries on SM15K servers. The REST API calls are failing for power action on SM15K node and the issue is related to the maas node ID is getting passed into the call instead of the System ID from power parameters. For example, servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 should be servers/0/0 for System ID 0 ==> /var/log/maas/clusterd.log <== 2016-01-08 14:37:23+0000 [-] Unhandled failure dispatching AMP command. This is probably a bug. Please ensure that this error is handled within application code or declared in the signature of the PowerQuery command. [maas-trusty-back-may22:pid=1553:cmd=PowerQuery:ask=2e3] Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 423, in errback self._startRunCallbacks(fail) File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 490, in _startRunCallbacks self._runCallbacks() File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks current.result = callback(current.result, *args, **kw) File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1155, in gotResult _inlineCallbacks(r, g, deferred) --- <exception caught here> --- File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/usr/lib/python2.7/dist-packages/provisioningserver/power/query.py", line 126, in get_power_state system_id, hostname, power_type, context) File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/__init__.py", line 246, in query self.power_query, system_id, context) File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 191, in _worker result = context.call(ctx, function, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext return self.currentContext().callWithContext(ctx, func, *args, **kw) File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext return func(*args,**kw) File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/seamicro.py", line 98, in power_query ip, username, password, system_id) File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/hardware/seamicro.py", line 344, in power_query_seamicro15k_v2 server = api.servers.get(server_id) File "/usr/lib/python2.7/dist-packages/seamicroclient/v2/servers.py", line 69, in get "/servers/%s" % base.getid(server)) File "/usr/lib/python2.7/dist-packages/seamicroclient/base.py", line 87, in _get _resp, body = self.api.client.get(url) File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 173, in get return self._cs_request(url, 'GET', **kwargs) File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 158, in _cs_request method,**kwargs) File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 140, in _time_request resp, body = self.request(url, method, **kwargs) File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 134, in request raise exceptions.from_response(resp, body, url, method) seamicroclient.exceptions.NotFound: Not Found: servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 (HTTP 404) We upgraded to 1.9.0+bzr4533-0ubuntu1~trusty1 and maas is failing to do power queries on SM15K servers. The REST API calls are failing for power action on SM15K node and the issue is related to the maas node ID is getting passed into the call instead of the System ID from power parameters. For example, servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 should be servers/0/0 for System ID 0 ==> /var/log/maas/clusterd.log <== 2016-01-08 14:37:23+0000 [-] Unhandled failure dispatching AMP command. This is probably a bug. Please ensure that this error is handled within application code or declared in the signature of the PowerQuery command. [maas-trusty-back-may22:pid=1553:cmd=PowerQuery:ask=2e3]         Traceback (most recent call last):           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 423, in errback             self._startRunCallbacks(fail)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 490, in _startRunCallbacks             self._runCallbacks()           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks             current.result = callback(current.result, *args, **kw)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1155, in gotResult             _inlineCallbacks(r, g, deferred)         --- <exception caught here> ---           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python2.7/dist-packages/provisioningserver/power/query.py", line 126, in get_power_state             system_id, hostname, power_type, context)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/__init__.py", line 246, in query             self.power_query, system_id, context)           File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 191, in _worker             result = context.call(ctx, function, *args, **kwargs)           File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext             return self.currentContext().callWithContext(ctx, func, *args, **kw)           File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext             return func(*args,**kw)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/seamicro.py", line 98, in power_query             ip, username, password, system_id)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/hardware/seamicro.py", line 344, in power_query_seamicro15k_v2             server = api.servers.get(server_id)           File "/usr/lib/python2.7/dist-packages/seamicroclient/v2/servers.py", line 69, in get             "/servers/%s" % base.getid(server))           File "/usr/lib/python2.7/dist-packages/seamicroclient/base.py", line 87, in _get             _resp, body = self.api.client.get(url)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 173, in get             return self._cs_request(url, 'GET', **kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 158, in _cs_request             method,**kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 140, in _time_request             resp, body = self.request(url, method, **kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 134, in request             raise exceptions.from_response(resp, body, url, method)         seamicroclient.exceptions.NotFound: Not Found: servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 (HTTP 404)
2016-01-08 16:38:07 Larry Michel description We upgraded to 1.9.0+bzr4533-0ubuntu1~trusty1 and maas is failing to do power queries on SM15K servers. The REST API calls are failing for power action on SM15K node and the issue is related to the maas node ID is getting passed into the call instead of the System ID from power parameters. For example, servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 should be servers/0/0 for System ID 0 ==> /var/log/maas/clusterd.log <== 2016-01-08 14:37:23+0000 [-] Unhandled failure dispatching AMP command. This is probably a bug. Please ensure that this error is handled within application code or declared in the signature of the PowerQuery command. [maas-trusty-back-may22:pid=1553:cmd=PowerQuery:ask=2e3]         Traceback (most recent call last):           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 423, in errback             self._startRunCallbacks(fail)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 490, in _startRunCallbacks             self._runCallbacks()           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks             current.result = callback(current.result, *args, **kw)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1155, in gotResult             _inlineCallbacks(r, g, deferred)         --- <exception caught here> ---           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python2.7/dist-packages/provisioningserver/power/query.py", line 126, in get_power_state             system_id, hostname, power_type, context)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/__init__.py", line 246, in query             self.power_query, system_id, context)           File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 191, in _worker             result = context.call(ctx, function, *args, **kwargs)           File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext             return self.currentContext().callWithContext(ctx, func, *args, **kw)           File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext             return func(*args,**kw)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/seamicro.py", line 98, in power_query             ip, username, password, system_id)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/hardware/seamicro.py", line 344, in power_query_seamicro15k_v2             server = api.servers.get(server_id)           File "/usr/lib/python2.7/dist-packages/seamicroclient/v2/servers.py", line 69, in get             "/servers/%s" % base.getid(server))           File "/usr/lib/python2.7/dist-packages/seamicroclient/base.py", line 87, in _get             _resp, body = self.api.client.get(url)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 173, in get             return self._cs_request(url, 'GET', **kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 158, in _cs_request             method,**kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 140, in _time_request             resp, body = self.request(url, method, **kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 134, in request             raise exceptions.from_response(resp, body, url, method)         seamicroclient.exceptions.NotFound: Not Found: servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 (HTTP 404) We upgraded to 1.9.0+bzr4533-0ubuntu1~trusty1 and maas is failing to do power queries for SM15K servers. The REST API calls are failing for power actions on SM15K nodes and the issue is related to the maas node getting passed into the call instead of the System ID from power parameters. For example, servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 should be servers/0/0 for System ID 0. ==> /var/log/maas/clusterd.log <== 2016-01-08 14:37:23+0000 [-] Unhandled failure dispatching AMP command. This is probably a bug. Please ensure that this error is handled within application code or declared in the signature of the PowerQuery command. [maas-trusty-back-may22:pid=1553:cmd=PowerQuery:ask=2e3]         Traceback (most recent call last):           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 423, in errback             self._startRunCallbacks(fail)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 490, in _startRunCallbacks             self._runCallbacks()           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks             current.result = callback(current.result, *args, **kw)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1155, in gotResult             _inlineCallbacks(r, g, deferred)         --- <exception caught here> ---           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python2.7/dist-packages/provisioningserver/power/query.py", line 126, in get_power_state             system_id, hostname, power_type, context)           File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks             result = result.throwExceptionIntoGenerator(g)           File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator             return g.throw(self.type, self.value, self.tb)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/__init__.py", line 246, in query             self.power_query, system_id, context)           File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 191, in _worker             result = context.call(ctx, function, *args, **kwargs)           File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext             return self.currentContext().callWithContext(ctx, func, *args, **kw)           File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext             return func(*args,**kw)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/power/seamicro.py", line 98, in power_query             ip, username, password, system_id)           File "/usr/lib/python2.7/dist-packages/provisioningserver/drivers/hardware/seamicro.py", line 344, in power_query_seamicro15k_v2             server = api.servers.get(server_id)           File "/usr/lib/python2.7/dist-packages/seamicroclient/v2/servers.py", line 69, in get             "/servers/%s" % base.getid(server))           File "/usr/lib/python2.7/dist-packages/seamicroclient/base.py", line 87, in _get             _resp, body = self.api.client.get(url)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 173, in get             return self._cs_request(url, 'GET', **kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 158, in _cs_request             method,**kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 140, in _time_request             resp, body = self.request(url, method, **kwargs)           File "/usr/lib/python2.7/dist-packages/seamicroclient/client.py", line 134, in request             raise exceptions.from_response(resp, body, url, method)         seamicroclient.exceptions.NotFound: Not Found: servers/node-7995ff76-b614-11e5-9e28-00163eca07b6/0 (HTTP 404)
2016-01-10 08:24:40 Larry Michel branch linked lp:~lmic/maas/maas19+fix-power-query-sm15k
2016-01-19 21:12:07 Blake Rouse nominated for series maas/1.9
2016-01-19 21:12:07 Blake Rouse bug task added maas/1.9
2016-01-19 21:12:12 Blake Rouse maas/1.9: milestone 1.9.1
2016-01-19 21:12:15 Blake Rouse maas: milestone next
2016-01-19 21:12:23 Blake Rouse maas: status New Triaged
2016-01-19 21:12:25 Blake Rouse maas/1.9: status New In Progress
2016-01-19 21:12:28 Blake Rouse maas: importance Undecided Critical
2016-01-19 21:12:30 Blake Rouse maas/1.9: importance Undecided Critical
2016-01-19 21:12:58 Blake Rouse maas: status Triaged Fix Committed
2016-02-24 16:08:47 Blake Rouse maas/1.9: status In Progress Fix Committed
2016-03-01 19:53:19 Andres Rodriguez maas: status Fix Committed Fix Released
2016-03-01 19:53:21 Andres Rodriguez maas/1.9: status Fix Committed Fix Released
2018-09-05 21:58:53 Andres Rodriguez maas: milestone next