Comment 3 for bug 1417825

Revision history for this message
Danny Choi (dannchoi) wrote :

A similar traceback is logged during VM deletion in the following scenario:

1. Uses Carol's latest patch for replay code, https://review.gerrithub.io/217434
2. Using CLI, launch 100 VMs using the cirros image, each VM with 2 interfaces of 2 different networks, that span across 3 Compute nodes.
3. Verify the two N9Ks are configured correctly with the VXLAN parameters.
4. Verify all 100 VMs are active and running.
5. Reboot the N9K that has the Network node and Compute-1 connected to it.
6. Upon boot up, verify the replay code reconfigures the switch correctly with the VXLAN parameters.
7. Using Horizon, delete 20 VMs at a time to delete all 100 VMs.
8. Verify the N9Ks config is removed correctly.
9. Check the traceback in screen-q-svc.log.
10. Note the following traceback.

2015-03-05 10:33:03.610 DEBUG neutron.plugins.ml2.drivers.cisco.nexus.nexus_network_driver [req-27f75e6b-c7eb-4e8e-8979-804c2dc34d4d admin 05e1512cadd84617a8cb4bc1f3e64c80
] NexusDriver:
      <config xmlns:xc="urn:ietf:params:xml:ns:netconf:base:1.0">
        <configure>
          <__XML__MODE__exec_configure>
<interface>
    <nve>nve1</nve>
    <__XML__MODE_if-nve>
        <member>no member vni 222224</member>
    </__XML__MODE_if-nve>
</interface>

          </__XML__MODE__exec_configure>
        </configure>
      </config>
 from (pid=31927) delete_nve_member /opt/stack/neutron/neutron/plugins/ml2/drivers/cisco/nexus/nexus_network_driver.py:380
2015-03-05 10:33:03.610 DEBUG neutron.plugins.ml2.drivers.cisco.nexus.nexus_network_driver [req-27f75e6b-c7eb-4e8e-8979-804c2dc34d4d admin 05e1512cadd84617a8cb4bc1f3e64c80
] NexusDriver config:
      <config xmlns:xc="urn:ietf:params:xml:ns:netconf:base:1.0">
        <configure>
          <__XML__MODE__exec_configure>
<interface>
    <nve>nve1</nve>
    <__XML__MODE_if-nve>
        <member>no member vni 222224</member>
    </__XML__MODE_if-nve>
</interface>

          </__XML__MODE__exec_configure>
        </configure>
      </config>
 from (pid=31927) _edit_config /opt/stack/neutron/neutron/plugins/ml2/drivers/cisco/nexus/nexus_network_driver.py:99
2015-03-05 10:33:03.612 INFO neutron.wsgi [req-5f6c2b8e-f759-4e88-ba7f-b6ae361b303e admin 05e1512cadd84617a8cb4bc1f3e64c80] 172.29.172.163 - - [05/Mar/
2015 10:33:03] "DELETE /v2.0/ports/ab786270-ed85-4439-afe4-672c05555b82.json HTTP/1.1" 204 149 2.072496
2015-03-05 10:33:03.840 ERROR neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus [req-27f75e6b-c7eb-4e8e-8979-804c2dc34d4d admin 05e1512cadd84617a8cb4bc1f3e64c80
] Nexus Driver cisco_nexus failed in (delete_nve_member||disable_vxlan_feature)
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus Traceback (most recent call last):
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus File "/opt/stack/neutron/neutron/plugins/ml2/drivers/cisco/nexus/mech_cisco_nexus.py",
 line 364, in _delete_nve_member
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus const.NVE_INT_NUM, vni)
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus File "/opt/stack/neutron/neutron/plugins/ml2/drivers/cisco/nexus/nexus_network_driver.
py", line 381, in delete_nve_member
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus self._edit_config(nexus_host, config=confstr)
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus File "/opt/stack/neutron/neutron/plugins/ml2/drivers/cisco/nexus/nexus_network_driver.
py", line 116, in _edit_config
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus exc=e)
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus NexusConfigFailed: Failed to configure Nexus switch: 172.20.231.7 XML:
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus <config xmlns:xc="urn:ietf:params:xml:ns:netconf:base:1.0">
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus <configure>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus <__XML__MODE__exec_configure>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus <interface>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus <nve>nve1</nve>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus <__XML__MODE_if-nve>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus <member>no member vni 222224</member>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus </__XML__MODE_if-nve>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus </interface>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus </__XML__MODE__exec_configure>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus </configure>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus </config>
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus . Reason: ERROR: VNI delete failed: Could not find vni node for 222224
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus .
2015-03-05 10:33:03.840 TRACE neutron.plugins.ml2.drivers.cisco.nexus.mech_cisco_nexus