Fuel for OpenStack

[swarm 10.0] Tests fail due to incorrect node-to-network assignment.

Bug #1632010 reported by Alexandra on 2016-10-10

This bug affects 1 person

	Status	Importance	Assigned to	Milestone
Fuel for OpenStack	Fix Committed	High	Dmitry Belyaninov	Fuel for OpenStack 11.0
Mitaka	Invalid	High	Fuel QA Team	Fuel for OpenStack 9.2
Newton	Fix Released	High	Dmitry Belyaninov	Fuel for OpenStack 10.0

Bug Description

Two swarm tests are failed:
https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.command_line/145/testReport/junit/(root)/cli_selected_nodes_deploy/cli_selected_nodes_deploy/
https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.command_line/145/testReport/junit/(root)/cli_selected_nodes_deploy_huge/cli_selected_nodes_deploy_huge/

Scenario:
1. Create environment using fuel-qa
2. Create a cluster using Fuel CLI
3. Add floating ranges for public network
4. Get cluster settings
5. Provision a controller node using Fuel CLI
6. Provision two compute+cinder nodes using Fuel CLI
7. Deploy the controller node using Fuel CLI
8. Deploy the compute+cinder nodes using Fuel CLI

Actual result:
step7 (controller): OK
step8 (compute): NOK

Initially no public network available for compute (after https://review.openstack.org/#/c/292356/)

https://github.com/openstack/fuel-qa/blob/0dcc0a988caf86d91e506aa8b9c172b5d509ad6b/fuelweb_test/tests/test_cli_base.py#L429
Method update_node_interfaces() doesn't take into account changes from https://review.openstack.org/#/c/292356/ =>

here is an updated network configuration for compute+cinder:
[{"name": "enp0s3", "assigned_networks": [{"id": 1, "name": "fuelweb_admin"}], "driver": "e1000", "state": "up", "mac": "64:e3:ec:ed:b7:f6", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 6, "pxe": true, "bus_info": "0000:00:03.0"}, {"name": "enp0s4", "assigned_networks": [{"id": 2, "name": "public"}], "driver": "e1000", "state": "down", "mac": "64:58:60:79:36:90", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 7, "pxe": false, "bus_info": "0000:00:04.0"}, {"name": "enp0s5", "assigned_networks": [{"id": 3, "name": "management"}], "driver": "e1000", "state": "down", "mac": "64:6d:1e:94:d9:ff", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 8, "pxe": false, "bus_info": "0000:00:05.0"}, {"name": "enp0s6", "assigned_networks": [{"id": 5, "name": "private"}], "driver": "e1000", "state": "down", "mac": "64:bf:7c:69:1e:bd", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 9, "pxe": false, "bus_info": "0000:00:06.0"}, {"name": "enp0s7", "assigned_networks": [{"id": 4, "name": "storage"}], "driver": "e1000", "state": "down", "mac": "64:cf:b2:1b:39:9b", "max_speed": 1000, "current_speed": 1000, "interface_properties": {"numa_node": 0, "pci_id": "8086:100e", "mtu": null, "disable_offloading": false, "sriov": {"available": false, "sriov_numvfs": null, "enabled": false, "pci_id": "", "sriov_totalvfs": 0, "physnet": "physnet2"}, "dpdk": {"available": true, "enabled": false}}, "offloading_modes": [{"state": null, "name": "rx-all", "sub": []}, {"state": null, "name": "rx-fcs", "sub": []}, {"state": null, "name": "tx-nocache-copy", "sub": []}, {"state": null, "name": "rx-vlan-offload", "sub": []}, {"state": null, "name": "generic-receive-offload", "sub": []}, {"state": null, "name": "generic-segmentation-offload", "sub": []}, {"state": null, "name": "tcp-segmentation-offload", "sub": [{"state": null, "name": "tx-tcp-segmentation", "sub": []}]}, {"state": null, "name": "scatter-gather", "sub": [{"state": null, "name": "tx-scatter-gather", "sub": []}]}, {"state": null, "name": "tx-checksumming", "sub": [{"state": null, "name": "tx-checksum-ip-generic", "sub": []}]}, {"state": null, "name": "rx-checksumming", "sub": []}], "type": "ether", "id": 10, "pxe": false, "bus_info": "0000:00:07.0"}]

=> failed to upload these settings due to https://review.openstack.org/#/c/308957

Tags:

Revision history for this message

Alexandra (aallakhverdieva) wrote on 2016-10-10:

sys_test.log Edit (19.7 MiB, text/html)

Revision history for this message

Alexandra (aallakhverdieva) wrote on 2016-10-10:

Reproduced on 10.0 #839

Oleksiy Molchanov (omolchanov) on 2016-10-11

tags:	added: area-python
Changed in fuel:
milestone:	none → 10.0

Revision history for this message

Alexandra (aallakhverdieva) wrote on 2016-10-17:

New fail:
https://product-ci.infra.mirantis.net/job/10.0.system_test.ubuntu.command_line/148/testReport/(root)/cli_selected_nodes_deploy_huge/

Revision history for this message

Vladimir Kuklin (vkuklin) wrote on 2016-12-09:

Nailgun behaviour is as expected here - we should not assign public network to the node which has public network disabled. Thus, the test itself should be fixed to avoid assigning irrelevant networks to the nodes.

Changed in fuel:
milestone:	10.0 → 11.0
summary:	- [swarm 10.0] Bad request during network upload action: Trying to assign - public network to Node which should not have public network + [swarm 10.0] Tests fail due to incorrect node-to-network assignment.

Dmitry Pyzhov (dpyzhov) on 2016-12-12

Changed in fuel:
assignee:	Fuel Sustaining (fuel-sustaining-team) → Fuel QA Team (fuel-qa)

Tatyana Borukhovich (tatyanaborukhovich) on 2016-12-16

tags:

added: swarm-blocker

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-12-26: Fix proposed to fuel-qa (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/414935

Revision history for this message

Nastya Urlapova (aurlapova) wrote on 2017-01-10:

Test is green for 9.2, moved to invalid: https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.command_line/170/testReport/(root)/cli_selected_nodes_deploy_huge/history/

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-01-11: Fix proposed to fuel-qa (master)

Fix proposed to branch: master
Review: https://review.openstack.org/418826

Changed in fuel:
assignee:	Fuel QA Team (fuel-qa) → Dmitry Belyaninov (dbelyaninov)
status:	Confirmed → In Progress

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-01-11: Fix merged to fuel-qa (stable/newton)

Reviewed: https://review.openstack.org/414935
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=2b73ac1e3d2144c19790e0609a6f7a468fd21410
Submitter: Jenkins
Branch: stable/newton

commit 2b73ac1e3d2144c19790e0609a6f7a468fd21410
Author: Dmitry Belyaninov <email address hidden>
Date: Mon Dec 26 11:18:17 2016 +0000

Allow public network assignment for all nodes

    By default settings public network can be
    assignment only to nodes with controller role.
    So tests should be updated to enable 'assign_to_all_nodes'
    paramater for clusters.
    For more info see:
    https://review.openstack.org/#/c/292356/

Change-Id: Ib3d8b48076a0597a08cd273d5be361ce4cbd902d
Closes-Bug: 1632010

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-01-11: Fix merged to fuel-qa (master)

Reviewed: https://review.openstack.org/418826
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=e1eedd410af7b2f731e87347e0432310017bee13
Submitter: Jenkins
Branch: master

commit e1eedd410af7b2f731e87347e0432310017bee13
Author: Dmitry Belyaninov <email address hidden>
Date: Mon Dec 26 11:18:17 2016 +0000

Allow public network assignment for all nodes

Change-Id: Ib3d8b48076a0597a08cd273d5be361ce4cbd902d
Closes-Bug: 1632010