[2.0b4] Registering external rack controller tracebacks

Bug #1577970 reported by Andres Rodriguez on 2016-05-03
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
MAAS
Critical
Lee Trager

Bug Description

2016-05-04 06:40:19 [-] Rack controller '4y3ha6' needs to be refreshed; performing the refresh operation.
2016-05-04 06:40:19 [-] Unhandled error in Deferred:
2016-05-04 06:40:19 [-] Unhandled Error
        Traceback (most recent call last):
          File "/usr/lib/python3.5/threading.py", line 862, in run
            self._target(*self._args, **self._kwargs)
          File "/usr/lib/python3/dist-packages/provisioningserver/utils/twisted.py", line 875, in worker
            return target()
          File "/usr/lib/python3/dist-packages/twisted/_threads/_threadworker.py", line 46, in work
            task()
          File "/usr/lib/python3/dist-packages/twisted/_threads/_team.py", line 190, in doWork
            task()
        --- <exception caught here> ---
          File "/usr/lib/python3/dist-packages/twisted/python/threadpool.py", line 246, in inContext
            result = inContext.theWork()
          File "/usr/lib/python3/dist-packages/twisted/python/threadpool.py", line 262, in <lambda>
            inContext.theWork = lambda: context.call(ctx, func, *args, **kw)
          File "/usr/lib/python3/dist-packages/twisted/python/context.py", line 118, in callWithContext
            return self.currentContext().callWithContext(ctx, func, *args, **kw)
          File "/usr/lib/python3/dist-packages/twisted/python/context.py", line 81, in callWithContext
            return func(*args,**kw)
          File "/usr/lib/python3/dist-packages/provisioningserver/utils/twisted.py", line 908, in callInContext
            return func(*args, **kwargs)
          File "/usr/lib/python3/dist-packages/maasserver/utils/orm.py", line 516, in call_within_transaction
            return func_outside_txn(*args, **kwargs)
          File "/usr/lib/python3/dist-packages/maasserver/utils/orm.py", line 343, in retrier
            return func(*args, **kwargs)
          File "/usr/lib/python3.5/contextlib.py", line 30, in inner
            return func(*args, **kwds)
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 3578, in refresh
            self.save()
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 1278, in save
            super(Node, self).save(*args, **kwargs)
          File "/usr/lib/python3/dist-packages/maasserver/models/cleansave.py", line 28, in save
            self.full_clean()
          File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 1156, in full_clean
            self.clean()
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 1260, in clean
            self.clean_status(prev)
          File "/usr/lib/python3/dist-packages/maasserver/models/node.py", line 1229, in clean_status
            raise NodeStateViolation(error_text)
        maasserver.exceptions.NodeStateViolation: Invalid transition: Deployed -> Commissioning.
2016-05-04 06:40:19 [RegionServer,20,192.168.10.2] Successfully configured DHCPv4 on rack controller '4y3ha6'.
2016-05-04 06:40:19 [RegionServer,20,192.168.10.2] Successfully configured DHCPv6 on rack controller '4y3ha6'.
2016-05-04 06:40:20 [-] Successfully configured DNS.
2016-05-04 06:40:21 [RegionServer,1,192.168.20.104] Successfully configured DHCPv4 on rack controller '4y3h7n'.
2016-05-04 06:40:22 [RegionServer,2,192.168.10.27] Successfully configured DHCPv4 on rack controller '4y3h7n'.
2016-05-04 06:40:22 [RegionServer,1,192.168.20.104] Successfully configured DHCPv6 on rack controller '4y3h7n'.
2016-05-04 06:40:22 [RegionServer,2,192.168.10.27] Successfully configured DHCPv6 on rack controller '4y3h7n'.
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:23 +0000] "GET /MAAS/images-stream/streams/v1/index.json HTTP/1.1" 200 210 "-" "python-requests/2.9.1"
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:24 +0000] "GET /MAAS/images-stream/streams/v1/maas:v2:download.json HTTP/1.1" 200 559 "-" "python-requests/2.9.1"
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:23 +0000] "GET /MAAS/images-stream/streams/v1/index.json HTTP/1.1" 200 210 "-" "python-requests/2.9.1"
2016-05-04 06:40:24 [-] 192.168.10.2 - - [03/May/2016:22:40:23 +0000] "GET /MAAS/images-stream/streams/v1/maas:v2:download.json HTTP/1.1" 200 559 "-" "python-requests/2.9.1"
2016-05-04 06:40:26 [-] 192.168.10.2 - - [03/May/2016:22:40:25 +0000] "GET /MAAS/images-stream/ubuntu/amd64/hwe-x/xenial/20160420.3/boot-initrd HTTP/1.1" 200 35749715 "-" "python-requests/2.9.1"
2016-05-04 06:40:26 [maasserver] ERROR: Unable to get RPC connection for rack controller 'maas-rack2' (4y3ha6)
2016-05-04 06:40:26 [-] 192.168.10.2 - - [03/May/2016:22:40:25 +0000] "GET /MAAS/images-stream/ubuntu/amd64/hwe-x/xenial/20160420.3/boot-kernel HTTP/1.1" 200 6756274 "-" "python-requests/2.9.1"
2016-05-04 06:40:35 [-] 192.168.10.2 - - [03/May/2016:22:40:34 +0000] "GET /MAAS/images-stream/ubuntu/amd64/hwe-x/xenial/20160420.3/root-image.gz HTTP/1.1" 200 198751918 "-" "python-requests/2.9.1"
2016-05-04 06:40:35 [-] 127.0.0.1 - - [03/May/2016:22:40:34 +0000] "GET /MAAS/rpc/ HTTP/1.0" 200 432 "-" "provisioningserver.rpc.clusterservice.ClusterClientService"
2016-05-04 06:40:37 [maasserver] ERROR: Unable to get RPC connection for rack controller 'maas-rack2' (4y3ha6)
2016-05-04 06:40:48 [maasserver] ERROR: Unable to get RPC connection for rack controller 'maas-rack2' (4y3ha6)
2016-05-04 06:40:49 [twisted.internet.protocol.Factory] RegionServer connection established (HOST:IPv4Address(TCP, '192.168.10.27', 5250) PEER:IPv4Address(TCP, '192.168.10.2', 38426))
2016-05-04 06:40:49 [twisted.internet.protocol.Factory] RegionServer connection established (HOST:IPv4Address(TCP, '192.168.20.104', 5253) PEER:IPv4Address(TCP, '192.168.20.5', 40226))
2016-05-04 06:40:49 [RegionServer,18,192.168.10.2] Rack controller authenticated from '192.168.10.2:38426'.
2016-05-04 06:40:49 [RegionServer,20,192.168.20.5] Rack controller authenticated from '192.168.20.5:40226'.

Related branches

Changed in maas:
milestone: none → 2.0.0
importance: Undecided → Critical
status: New → Confirmed
Gavin Panella (allenap) on 2016-05-04
Changed in maas:
status: Confirmed → Triaged
Changed in maas:
status: Triaged → Fix Committed
assignee: nobody → Lee Trager (ltrager)
Changed in maas:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers