MAAS

[2.0a3 pre] maas-rackd attemps to connect to regiond, constantely, without stop

Bug #1559330 reported by Andres Rodriguez
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
MAAS
Fix Released
Critical
Blake Rouse
MAAS 2.0.0

Bug Description

restarted maas-rackd and i see the following:

2016-03-19 06:05:45+0800 [-] Log opened.
2016-03-19 06:05:45+0800 [-] twistd 16.0.0pre1 (/usr/bin/python3 3.5.1) starting up.
2016-03-19 06:05:45+0800 [-] reactor class: twisted.internet.epollreactor.EPollReactor.
2016-03-19 06:05:45+0800 [-] Site starting on 5248
2016-03-19 06:05:45+0800 [-] <class 'provisioningserver.pserv_services.lease_socket_service.LeaseSocketService'> starting on '/var/lib/maas/dhcpd.sock'
2016-03-19 06:05:45+0800 [-] Starting protocol <provisioningserver.pserv_services.lease_socket_service.LeaseSocketService object at 0x7fe241b38390>
2016-03-19 06:05:45+0800 [-] TFTP starting on 69
2016-03-19 06:05:45+0800 [-] Starting protocol <tftp.protocol.TFTP object at 0x7fe2418fff60>
2016-03-19 06:05:45+0800 [-] TFTP Listener started at ::1:69
2016-03-19 06:05:45+0800 [-] TFTP starting on 69
2016-03-19 06:05:45+0800 [-] Starting protocol <tftp.protocol.TFTP object at 0x7fe24190c320>
2016-03-19 06:05:45+0800 [-] TFTP Listener started at 192.168.20.104:69
2016-03-19 06:05:45+0800 [-] TFTP starting on 69
2016-03-19 06:05:45+0800 [-] Starting protocol <tftp.protocol.TFTP object at 0x7fe24190c4a8>
2016-03-19 06:05:45+0800 [-] TFTP Listener started at 10.216.160.107:69
2016-03-19 06:05:45+0800 [-] TFTP starting on 69
2016-03-19 06:05:45+0800 [-] Starting protocol <tftp.protocol.TFTP object at 0x7fe24190c550>
2016-03-19 06:05:45+0800 [-] TFTP Listener started at 127.0.0.1:69
2016-03-19 06:05:45+0800 [-] TFTP starting on 69
2016-03-19 06:05:45+0800 [-] Starting protocol <tftp.protocol.TFTP object at 0x7fe24190c588>
2016-03-19 06:05:45+0800 [-] TFTP Listener started at 192.168.10.27:69
2016-03-19 06:05:45+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37352) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:05:45+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37837) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:05:45+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35202) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:05:45+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:05:45+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:05:45+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:05:47+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37361) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:05:47+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37847) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:05:47+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35212) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:05:47+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:05:47+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:05:47+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:05:49+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37373) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:05:49+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37859) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:05:49+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35223) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:05:49+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:05:49+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:05:51+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:05:51+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37380) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:05:51+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37865) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:05:51+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35229) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:05:51+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:05:51+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:05:53+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37386) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:05:53+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37871) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:05:53+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35236) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:05:54+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:05:54+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:05:55+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37395) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:05:55+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37880) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:05:55+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35245) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:05:55+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:05:55+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:06:11+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:06:11+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:06:12+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:06:12+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37446) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:06:12+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37931) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:12+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35296) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:06:12+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:06:12+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:06:13+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37454) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:06:13+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37939) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:13+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35304) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:06:13+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:06:13+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:06:15+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37462) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:06:15+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37948) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:15+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35313) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:06:15+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:06:15+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.
2016-03-19 06:06:20+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:06:20+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37837) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:23+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:06:23+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37847) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:24+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:06:24+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37859) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:29+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:06:29+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37871) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:38+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:06:38+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37948) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:06:48+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:06:48+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37880) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:07:02+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:07:02+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37931) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:07:03+0800 [ClusterClient,client] Rack controller REJECTED by the region (via trusty-maas9:pid=12292).
2016-03-19 06:07:03+0800 [ClusterClient,client] ClusterClient connection lost (HOST:IPv4Address(TCP, '127.0.0.1', 37865) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:07:09+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:07:09+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:07:09+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12286' authenticated.
2016-03-19 06:07:09+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '192.168.20.104', 37510) PEER:IPv4Address(TCP, '192.168.20.104', 5252))
2016-03-19 06:07:09+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '127.0.0.1', 37995) PEER:IPv4Address(TCP, '127.0.0.1', 5251))
2016-03-19 06:07:09+0800 [Uninitialized] ClusterClient connection established (HOST:IPv4Address(TCP, '10.216.160.107', 35359) PEER:IPv4Address(TCP, '10.216.160.107', 5253))
2016-03-19 06:07:09+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12288' authenticated.
2016-03-19 06:07:09+0800 [ClusterClient,client] Event-loop 'trusty-maas9:pid=12292' authenticated.

Related branches

lp:~blake-rouse/maas/better-reg-move-trigger
Mike Pontillo (community): Approve
Diff: 493 lines (+210/-119)
9 files modified
src/maasserver/management/commands/dbupgrade.py (+21/-0)
src/maasserver/rpc/rackcontrollers.py (+36/-28)
src/maasserver/rpc/regionservice.py (+11/-2)
src/maasserver/rpc/testing/fixtures.py (+7/-3)
src/maasserver/rpc/tests/test_rackcontrollers.py (+60/-77)
src/maasserver/rpc/tests/test_regionservice.py (+49/-0)
src/maasserver/start_up.py (+0/-4)
src/maasserver/tests/test_commands_dbupgrade.py (+26/-0)
src/maasserver/tests/test_start_up.py (+0/-5)
Andres Rodriguez (andreserl)
Changed in maas:
importance: Undecided → Critical
status: New → Confirmed
milestone: none → 2.0.0
Gavin Panella (allenap)
Changed in maas:
status: Confirmed → Triaged
Andres Rodriguez (andreserl)
summary: - [2.0a3 pre] maas-rackd constantely attemps to connect to regiond without
- stop
+ [2.0a3 pre] maas-rackd attemps to connect to regiond, constantely,
+ without stop
Blake Rouse (blake-rouse)
Changed in maas:
assignee: nobody → Blake Rouse (blake-rouse)
status: Triaged → In Progress
Blake Rouse (blake-rouse)
Changed in maas:
status: In Progress → Fix Committed
Andres Rodriguez (andreserl)
Changed in maas:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.