Cisco Nexus VXLAN: incomplete switch configuration when launch multiple VMs simultaneously.
Bug #1399998 reported by
Danny Choi
This bug affects 3 people
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
networking-cisco |
Fix Committed
|
Medium
|
Carol Bouchard |
Bug Description
Cisco Nexus VXLAN setup:
Compute-1 and Compute-2 connect to N9K-1, Compute-3 and Controller+Network node connect to N9K-2.
Issue: when launch multiple VMs simultaneously, the Nexus switch is not configured properly. Sometimes missing the VLAN, or the VNI mapping. It is not consistent. Sometimes happen to the 1st switch, sometimes to the 2nd switch.
Steps to reproduce:
1. Fresh reboot both N9K switches.
2. At Controller CLI, launch 10 VMs each with 3 interfaces in different subnet.
3. Check the switches configuration.
tags: | added: cisco |
Changed in neutron: | |
importance: | Undecided → Medium |
status: | New → Confirmed |
Changed in neutron: | |
assignee: | nobody → Carol Bouchard (caboucha) |
affects: | neutron → networking-cisco |
Changed in networking-cisco: | |
status: | Confirmed → Fix Committed |
Changed in networking-cisco: | |
milestone: | none → 1.0.0 |
To post a comment you must log in.
It also happens with 10 VMs each with one interface.
Note: it happens consistently after a reload of the Nexus switches.
The following tracebacks are logged in screen-q-svc.log:
from (pid=30887) _edit_config /opt/stack/ neutron/ neutron/ plugins/ ml2/drivers/ cisco/nexus/ nexus_network_ driver. py:86 plugins. ml2.managers [req-d8c65cd0- 138f-4397- 8d78-86f5196260 ca None None] Mechanism driver 'cisco_nexus' failed in update_ port_postcommit plugins. ml2.managers Traceback (most recent call last): plugins. ml2.managers File "/opt/stack/ neutron/ neutron/ plugins/ ml2/managers. py", line 299, in _call_on_drivers plugins. ml2.managers getattr(driver.obj, method_ name)(context) plugins. ml2.managers File "/opt/stack/ neutron/ neutron/ plugins/ ml2/drivers/ cisco/nexus/ mech_cisco_ nexus.py" , line 378, in update_ port_postcommit plugins. ml2.managers self._configure _nve_member) if vxlan_segment else 0 plugins. ml2.managers File "/opt/stack/ neutron/ neutron/ plugins/ ml2/drivers/ cisco/nexus/ mech_cisco_ nexus.py" , line 325, in _port_action_vxlan plugins. ml2.managers func(vni, device_id, mcast_group, host_id) plugins. ml2.managers File "/opt/stack/ neutron/ neutron/ plugins/ ml2/drivers/ cisco/nexus/ mech_cisco_ nexus.py" , line 135, in _configure_ nve_member plugins. ml2.managers vni, mcast_group) plugins. ml2.managers File "/opt/stack/ neutron/ neutron/ plugins/ ml2/drivers/ cisco/nexus/ nexus_network_ driver. py", line 308, in create_nve_member plugins. ml2.managers self._edit_ config( nexus_host, config=confstr) plugins. ml2.managers File "/opt/stack/ neutron/ neutron/ plugins/ ml2/drivers/ cisco/nexus/ nexus_network_ driver. py", line 94, in _edit_config plugins. ml2.managers raise cexc.NexusConfi gFailed( config= config, exc=e) plugins. ml2.managers NexusConfigFailed: Failed to configure Nexus: plugins. ml2.managers <config xmlns:xc= "urn:ietf: params: xml:ns: netconf: base:1. 0"> plugins. ml2.managers <configure> plugins. ml2.managers <__XML_ _MODE__ exec_configure> plugins. ml2.managers <interface> plugins. ml2.managers <nve>nve1</nve> plugins. ml2.managers <__XML_ _MODE_if- nve> plugins. ml2.managers <member>member vni 9000 mcast-group 225.1.1.1</member> plugins. ml2.managers </__XML_ _MODE_if- nve> plugins. ml2.managers </interface>
2014-12-06 17:09:26.063 ERROR neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063 TRACE neutron.
2014-12-06 17:09:26.063...