neutron

Router interfaces exists on all the controllers after making L3 agent down on active controller i.e duplicate ip's present with duplication of ping

Bug #1547412 reported by Abhishek G M on 2016-02-19

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	neutron	Won't Fix	Undecided	Unassigned

Bug Description

Steps to reproduce:
1)Create a router
2)Add router interface to subnet
3)boot a vm
4)create a floating ip and associate it to vm port id
5)Make l3 agent down on active controller
stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 23ec6a25-b578-4630-86ba-3a544293385b
---------------------------------------------------------------------------------------
id host admin_state_up alive ha_state
---------------------------------------------------------------------------------------
5d47d95e-3750-4007-86b3-a724092cfd85 padawan-ccp-c1-m3-mgmt True active
24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True xxx standby
---------------------------------------------------------------------------------------
stack@padawan-ccp-c1-m2-mgmt:~$ sudo ip netns exec qrouter-23ec6a25-b578-4630-86ba-3a544293385b ifconfig
ha-b6dcf491-e6 Link encap:Ethernet HWaddr fa:16:3e:ce:ff:13
inet addr:169.254.192.5 Bcast:169.254.255.255 Mask:255.255.192.0
inet6 addr: fe80::f816:3eff:fece:ff13/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:3650 errors:0 dropped:391 overruns:0 frame:0
TX packets:404 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:229496 (224.1 KiB) TX bytes:22476 (21.9 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
qg-3d627c6b-86 Link encap:Ethernet HWaddr fa:16:3e:70:95:f3
inet addr:10.36.0.24 Bcast:0.0.0.0 Mask:255.255.0.0
inet6 addr: fe80::f816:3eff:fe70:95f3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:8961 errors:0 dropped:8 overruns:0 frame:0
TX packets:249 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:600352 (586.2 KiB) TX bytes:20626 (20.1 KiB)
qr-ba518ea4-f7 Link encap:Ethernet HWaddr fa:16:3e:9f:89:aa
inet addr:7.7.7.1 Bcast:0.0.0.0 Mask:255.255.255.0
inet6 addr: fe80::f816:3eff:fe9f:89aa/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:923 errors:0 dropped:1 overruns:0 frame:0
TX packets:395 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:79946 (78.0 KiB) TX bytes:38625 (37.7 KiB)
stack@padawan-ccp-c1-m3-mgmt:~$ sudo ip netns exec qrouter-23ec6a25-b578-4630-86ba-3a544293385b ifconfig
ha-47cfce0e-c5 Link encap:Ethernet HWaddr fa:16:3e:db:39:24
inet addr:169.254.192.6 Bcast:169.254.255.255 Mask:255.255.192.0
inet6 addr: fe80::f816:3eff:fedb:3924/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:3223 errors:0 dropped:581 overruns:0 frame:0
TX packets:833 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:196426 (191.8 KiB) TX bytes:46062 (44.9 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
qg-3d627c6b-86 Link encap:Ethernet HWaddr fa:16:3e:70:95:f3
inet addr:10.36.0.24 Bcast:0.0.0.0 Mask:255.255.0.0
inet6 addr: fe80::f816:3eff:fe70:95f3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2522 errors:0 dropped:0 overruns:0 frame:0
TX packets:1059 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:213140 (208.1 KiB) TX bytes:98562 (96.2 KiB)
qr-ba518ea4-f7 Link encap:Ethernet HWaddr fa:16:3e:9f:89:aa
inet addr:7.7.7.1 Bcast:0.0.0.0 Mask:255.255.255.0
inet6 addr: fe80::f816:3eff:fe9f:89aa/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1462 errors:0 dropped:0 overruns:0 frame:0
TX packets:1035 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:132248 (129.1 KiB) TX bytes:97302 (95.0 KiB)

==================================================================
checking if there is any loss in network traffic when L3 agent comes back. And verifying the master ownership of the HA router.

There is a duplicate ip in the network
Three things to discuss here,
1) Before making l3 agent down these are the status of controllers
m2 = active
m1 = stand_by
m3 = stand_by
I made m2 l3 agent down and started again, There is a 4 packet loss and the status of the controllers ofter making m2 l3 agent down is
m2 = stand_by
m1 = active
m3 = active
2 ) Before making l3 agent down,
m1 = active
m3 = active
m2 standby
I made l3 agent down of m1 and m3 controllers and started again, there is duplicate of ip address on controllers and there is no packet loss
After making l3 agent down here is the status of the controllers
m2 = active
m1 = active
m3 = active
3) Before making m2's L3 agent down
m2 = active
m1 = active
m3 = active
stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 1f9d90e8-8e5c-4b8a-aa8e-59f28edd2243
---------------------------------------------------------------------------------------
id host admin_state_up alive ha_state
---------------------------------------------------------------------------------------
5d47d95e-3750-4007-86b3-a724092cfd85 padawan-ccp-c1-m3-mgmt True active
24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True active
---------------------------------------------------------------------------------------
stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 5b20094e-e734-4961-a2b9-4b7812d50c02
---------------------------------------------------------------------------------------
id host admin_state_up alive ha_state
---------------------------------------------------------------------------------------
a291a2fd-0a2b-4bc3-b04c-ab750e4ae8db padawan-ccp-c1-m1-mgmt True active
24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True active
---------------------------------------------------------------------------------------
I made l3 agent down of m2 controller, and started again, there is a duplicate of ip address and duplicate of ping.
64 bytes from 10.36.0.6: icmp_seq=1 ttl=62 time=2.72 ms
64 bytes from 10.36.0.6: icmp_seq=1 ttl=62 time=2.75 ms (DUP!)
64 bytes from 10.36.0.6: icmp_seq=2 ttl=62 time=1.33 ms
64 bytes from 10.36.0.6: icmp_seq=3 ttl=62 time=0.648 ms
64 bytes from 10.36.0.6: icmp_seq=4 ttl=62 time=0.707 ms
64 bytes from 10.36.0.6: icmp_seq=5 ttl=62 time=0.658 ms

Revision history for this message

Abhishek G M (abhishek-g-m) wrote on 2016-02-19:

keepalived.zip Edit (3.2 KiB, application/zip)

summary:

Router interfaces exists on all the controllers after making L3 agent
- down on active controller i.r duplicate ip's present
+ down on active controller i.e duplicate ip's present with duplication of
+ ping

Revision history for this message

Abhishek G M (abhishek-g-m) wrote on 2016-02-19:

neutron-vpn-agent.7z Edit (259.6 KiB, application/x-7z-compressed)

Revision history for this message

Abhishek G M (abhishek-g-m) wrote on 2016-02-19:

keepalived_2.zip Edit (1.4 KiB, application/zip)

Revision history for this message

Assaf Muller (amuller) wrote on 2016-02-19:

How are you making the L3 agent down?

Revision history for this message

Abhishek G M (abhishek-g-m) wrote on 2016-03-02:

sudo service neutron-vpn-agent stop

Revision history for this message

Anseela M M (anseela-m00) wrote on 2016-03-18:

Can you please mention the version which you found this error?

Anseela M M (anseela-m00) on 2016-04-13

Changed in neutron:
assignee:	nobody → Anseela M M (anseela-m00)

Anseela M M (anseela-m00) on 2016-07-11

Changed in neutron:
assignee:	Anseela M M (anseela-m00) → nobody

Revision history for this message

Rodolfo Alonso (rodolfo-alonso-hernandez) wrote on 2022-10-20:

Bug closed due to lack of activity, please feel free to reopen if needed.

Changed in neutron:
status:	New → Won't Fix

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Bug attachments

Add attachment

Remote bug watches

Bug watches keep track of this bug in other bug trackers.