As you can see node-33 successfully ssh-ed to node-2 and fetched keys, but 34 and 35 failed with no route to host error. Logs on primary controller states that network on primary-controller (node-2) was up and running, all the rest were good too.
From my point of view it was problems with networking on your env, but anyway I will try to reproduce it on my env and post results here.
Deeper investigation shows that ceph failed on gathering keys from primary-controller
node-33: paste.openstack .org/show/ 380324/ paste.openstack .org/show/ 380325/ paste.openstack .org/show/ 380326/
http://
node-34:
http://
node-35:
http://
As you can see node-33 successfully ssh-ed to node-2 and fetched keys, but 34 and 35 failed with no route to host error. Logs on primary controller states that network on primary-controller (node-2) was up and running, all the rest were good too.
From my point of view it was problems with networking on your env, but anyway I will try to reproduce it on my env and post results here.