[sr-iov] controller unavailable after soft reboot

[Noam Angel]

scenario:
1. successfully deploy.
2. all health tests pass.
3. log in to one of the computes and do "reboot" command.

result:
controller that has been rebooted has no access on 192.168.0.0

deploy cluster:
3x Controller
2x compute
1x cinder

features:
vlan
mellanox plugin

snapshot:
https://drive.google.com/file/d/0B6QXR6Al7IxoRkdBamYzTzc2S1E/view?usp=sharing

[Noam Angel (noama)]

#node-80
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
default 10.209.86.1 0.0.0.0 UG 0 0 0 br-ex
10.20.0.0 * 255.255.255.0 U 0 0 0 br-fw-admin
10.209.86.0 * 255.255.255.0 U 0 0 0 br-ex
192.168.0.0 * 255.255.255.0 U 0 0 0 br-mgmt
192.168.1.0 * 255.255.255.0 U 0 0 0 vlan3
240.0.0.4 * 255.255.255.252 U 0 0 0 vr-host-base

#node-81
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
default 10.209.86.1 0.0.0.0 UG 0 0 0 br-ex
10.20.0.0 * 255.255.255.0 U 0 0 0 br-fw-admin
10.209.86.0 * 255.255.255.0 U 0 0 0 br-ex
169.254.169.254 - 255.255.255.255 !H 0 - 0 -
192.168.0.0 * 255.255.255.0 U 0 0 0 br-mgmt
192.168.1.0 * 255.255.255.0 U 0 0 0 vlan3
240.0.0.0 * 255.255.255.252 U 0 0 0 hapr-host
240.0.0.4 * 255.255.255.252 U 0 0 0 vr-host-base

#node-82
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
default 10.209.86.1 0.0.0.0 UG 0 0 0 br-ex
10.20.0.0 * 255.255.255.0 U 0 0 0 br-fw-admin
10.209.86.0 * 255.255.255.0 U 0 0 0 br-ex
169.254.169.254 - 255.255.255.255 !H 0 - 0 -
192.168.0.0 * 255.255.255.0 U 0 0 0 br-mgmt
192.168.1.0 * 255.255.255.0 U 0 0 0 vlan3
240.0.0.0 * 255.255.255.252 U 0 0 0 hapr-host
240.0.0.4 * 255.255.255.252 U 0 0 0 vr-host-base

[Noam Angel (noama)]

https://drive.google.com/file/d/0B6QXR6Al7IxoRkdBamYzTzc2S1E/view?usp=sharing

[Dmitry Bilunov (dbilunov)]

Which node has been rebooted and which one got connectivity problems?

[Noam Angel (noama)]

node-80 you can see its routes in prior message

[Dmitry Bilunov (dbilunov)]

Do you still have this env? Could you try running 'brctl addif br-mgmt enp5s0.2 && ifconfig enp5s0.2 up' on node-80?

[Dmitry Bilunov (dbilunov)]

Please also provide /var/log/dmesg contents from node-80 and node-81.

[Noam Angel (noama)]

environment is not available at the moment i will reproduce and send logs

[Bug Checker Bot (bug-checker)]

(This check performed automatically)
Please, make sure that bug description contains the following sections filled in with the appropriate data related to the bug you are describing:

actual result

version

expected result

steps to reproduce

For more detailed information on the contents of each of the listed sections see https://wiki.openstack.org/wiki/Fuel/How_to_contribute#Here_is_how_you_file_a_bug

[Matthew Mosesohn (raytrac3r)]

Marking is invalid. No reproduction for 1 month. We can reopen if this reproduces.