kernel.log from 10.21.1.36 contains the following:
2016-08-11T19:04:18.215408+00:00 info: [ 4.440441] i40e 0000:02:00.0: MAC address: 3c:fd:fe:9c:b1:1c
So the main version of what has happened is MAC address clash, however I cannot prove it - there is no data (except some logs) from these nodes in the snapshot.
There are 3 nodes with such error. Only one of them has a lot of the errors mentioned: 10.21.1.243.
This node also contains strange messages like this:
2016-08- 12T14:59: 55.736124+ 00:00 debug: 14:59:55.548728 #2061] DEBUG -- : Response: status: 409 body: {"message": "Node with mac 3C:FD:FE:9C:B1:1C already exists - doing nothing", "errors": []}
kernel.log from 10.21.1.36 contains the following:
2016-08- 11T19:04: 18.215408+ 00:00 info: [ 4.440441] i40e 0000:02:00.0: MAC address: 3c:fd:fe:9c:b1:1c
So the main version of what has happened is MAC address clash, however I cannot prove it - there is no data (except some logs) from these nodes in the snapshot.