[swarm 10.0] Tests fail due to incorrect node-to-network assignment.

Bug #1632010 reported by Alexandra
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Dmitry Belyaninov
Mitaka
Invalid
High
Fuel QA Team
Newton
Fix Released
High
Dmitry Belyaninov

Bug Description

Two swarm tests are failed:
https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.command_line/145/testReport/junit/(root)/cli_selected_nodes_deploy/cli_selected_nodes_deploy/
https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.command_line/145/testReport/junit/(root)/cli_selected_nodes_deploy_huge/cli_selected_nodes_deploy_huge/

Scenario:
1. Create environment using fuel-qa
2. Create a cluster using Fuel CLI
3. Add floating ranges for public network
4. Get cluster settings
5. Provision a controller node using Fuel CLI
6. Provision two compute+cinder nodes using Fuel CLI
7. Deploy the controller node using Fuel CLI
8. Deploy the compute+cinder nodes using Fuel CLI

Actual result:
step7 (controller): OK
step8 (compute): NOK

Initially no public network available for compute (after https://review.openstack.org/#/c/292356/)

https://github.com/openstack/fuel-qa/blob/0dcc0a988caf86d91e506aa8b9c172b5d509ad6b/fuelweb_test/tests/test_cli_base.py#L429
Method update_node_interfaces() doesn't take into account changes from https://review.openstack.org/#/c/292356/ =>

here is an updated network configuration for compute+cinder:
[{"name": "enp0s3", "assigned_networks": [{"id": 1, "name": "fuelweb_admin"}], "driver": "e1000", "state": "up", "mac": "64:e3:ec:ed:b7:f6", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 6, "pxe": true, "bus_info": "0000:00:03.0"}, {"name": "enp0s4", "assigned_networks": [{"id": 2, "name": "public"}], "driver": "e1000", "state": "down", "mac": "64:58:60:79:36:90", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 7, "pxe": false, "bus_info": "0000:00:04.0"}, {"name": "enp0s5", "assigned_networks": [{"id": 3, "name": "management"}], "driver": "e1000", "state": "down", "mac": "64:6d:1e:94:d9:ff", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 8, "pxe": false, "bus_info": "0000:00:05.0"}, {"name": "enp0s6", "assigned_networks": [{"id": 5, "name": "private"}], "driver": "e1000", "state": "down", "mac": "64:bf:7c:69:1e:bd", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 9, "pxe": false, "bus_info": "0000:00:06.0"}, {"name": "enp0s7", "assigned_networks": [{"id": 4, "name": "storage"}], "driver": "e1000", "state": "down", "mac": "64:cf:b2:1b:39:9b", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 10, "pxe": false, "bus_info": "0000:00:07.0"}]

=> failed to upload these settings due to https://review.openstack.org/#/c/308957

Revision history for this message
Alexandra (aallakhverdieva) wrote :
Revision history for this message
Alexandra (aallakhverdieva) wrote :

Reproduced on 10.0 #839

tags: added: area-python
Changed in fuel:
milestone: none → 10.0
Revision history for this message
Alexandra (aallakhverdieva) wrote :
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

Nailgun behaviour is as expected here - we should not assign public network to the node which has public network disabled. Thus, the test itself should be fixed to avoid assigning irrelevant networks to the nodes.

Changed in fuel:
milestone: 10.0 → 11.0
summary: - [swarm 10.0] Bad request during network upload action: Trying to assign
- public network to Node which should not have public network
+ [swarm 10.0] Tests fail due to incorrect node-to-network assignment.
Dmitry Pyzhov (dpyzhov)
Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Fuel QA Team (fuel-qa)
tags: added: swarm-blocker
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/414935

Revision history for this message
Nastya Urlapova (aurlapova) wrote :
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (master)

Fix proposed to branch: master
Review: https://review.openstack.org/418826

Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Dmitry Belyaninov (dbelyaninov)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (stable/newton)

Reviewed: https://review.openstack.org/414935
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=2b73ac1e3d2144c19790e0609a6f7a468fd21410
Submitter: Jenkins
Branch: stable/newton

commit 2b73ac1e3d2144c19790e0609a6f7a468fd21410
Author: Dmitry Belyaninov <email address hidden>
Date: Mon Dec 26 11:18:17 2016 +0000

    Allow public network assignment for all nodes

    By default settings public network can be
    assignment only to nodes with controller role.
    So tests should be updated to enable 'assign_to_all_nodes'
    paramater for clusters.
    For more info see:
    https://review.openstack.org/#/c/292356/

    Change-Id: Ib3d8b48076a0597a08cd273d5be361ce4cbd902d
    Closes-Bug: 1632010

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (master)

Reviewed: https://review.openstack.org/418826
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=e1eedd410af7b2f731e87347e0432310017bee13
Submitter: Jenkins
Branch: master

commit e1eedd410af7b2f731e87347e0432310017bee13
Author: Dmitry Belyaninov <email address hidden>
Date: Mon Dec 26 11:18:17 2016 +0000

    Allow public network assignment for all nodes

    By default settings public network can be
    assignment only to nodes with controller role.
    So tests should be updated to enable 'assign_to_all_nodes'
    paramater for clusters.
    For more info see:
    https://review.openstack.org/#/c/292356/

    Change-Id: Ib3d8b48076a0597a08cd273d5be361ce4cbd902d
    Closes-Bug: 1632010

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/fuel-qa 11.0.0.0rc1

This issue was fixed in the openstack/fuel-qa 11.0.0.0rc1 release candidate.

Revision history for this message
Dmitry Belyaninov (dbelyaninov) wrote :
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.