[DPDK] Network verification failed after successful deployment

[Maksym Strukov]

Steps:
1. Create new environment with VLAN segmentation for Neutron
2. Use KVM as hypervisor
3. Add controller and compute nodes
4. Configure HugePages for compute nodes: 256 2m pages for Nova and 128 mb for DPDK
5. Configure private network in DPDK mode
6. Run network verification
7. Deploy environment
8. Run network verification

Expected:
Network verification OK

Actual:
Node Name Node MAC address Node Interface Expected VLAN (not received)
slave-01_controller 64:a9:16:44:7e:5e enp0s6 1024, 1026, 1027, 1028, 1029, 1030, 1025, 1000, 1001, 1002, 1003, 1004, 1005, 1006, 1007, 1008, 1009, 1010, 1011, 1012, 1013, 1014, 1015, 1016, 1017, 1018, 1019, 1020, 1021, 1022, 1023

Env: 9.0-161

[Atsuko Ito (yottatsa)]

Possibly invalid: network checker could not be used for Private on DPDK node. So, if we have only 2 nodes: controller and dpdk-enabled compute, there is no interface to check it.

Should be fixed in network checker to carefully ignore DPDK/SR-IOV configuration, or network checker should be redesigned to support DPDK/SR-IOV, or test should be modified.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/309884

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/310712

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/309884
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=da050546b50c6139009fb0bb3ed2f2cd0b512240
Submitter: Jenkins
Branch: master

commit da050546b50c6139009fb0bb3ed2f2cd0b512240
Author: Fedor Zhadaev <email address hidden>
Date: Mon Apr 25 11:27:02 2016 +0300

    Fix Network Verification for environments with DPDK nodes

    Don't check private VLAN's when there is the only node
    without DPDK

    Closes-Bug: #1566963

    Change-Id: I07213976865168ffe6ab94110bb2894d91a049bd

[ElenaRossokhina (esolomina)]

I have the similar problem with network verification after deployment, but error message looks another:
Verification failed.
Repo availability verification failed on following nodes Untitled (e4:a1).
Following repos are not available - http://archive.ubuntu.com/ubuntu/, http://mirror.fuel-infra.org/mos-repos/ubuntu/9.0/.

Untitled (e4:a1) is compute node.
Network was successfully verified before deployment.

I tried same steps, but my cluster also contained cinder node (1 controller + 1 compute + 1 cinder)

Diagnostic snapshot is avilable: https://drive.google.com/a/mirantis.com/file/d/0B2ag_Bf-ShtTZHNEV1FKMjFtTzA/view?usp=sharing

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/314429

[Maksym Strukov (unbelll)]

Still repro in 9.0-mos-354

[Maksym Strukov (unbelll)]

Verified as fixed in 10.0-224

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/314429
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=42c6f87f2235b9a3b3118b2ba482541970435cba
Submitter: Jenkins
Branch: stable/mitaka

commit 42c6f87f2235b9a3b3118b2ba482541970435cba
Author: Fedor Zhadaev <email address hidden>
Date: Mon Apr 25 11:27:02 2016 +0300

    Fix Network Verification for environments with DPDK nodes

    Don't check private VLAN's when there is the only node
    without DPDK

    Closes-Bug: #1566963

    Change-Id: I07213976865168ffe6ab94110bb2894d91a049bd
    (cherry picked from commit da050546b50c6139009fb0bb3ed2f2cd0b512240)

[Fedor Zhadaev (fzhadaev)]

Returned to 'In Progress' since part of fix is still not merged
https://review.openstack.org/310712

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/310712
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=87f2304684d346309d3b33cdea50ac6fcc6be995
Submitter: Jenkins
Branch: master

commit 87f2304684d346309d3b33cdea50ac6fcc6be995
Author: Fedor Zhadaev <email address hidden>
Date: Thu Apr 28 12:28:48 2016 +0300

    Fix Network Templates Verification for environments with DPDK nodes

    Don't check private VLAN's when there is the only node
    without DPDK.

    Change-Id: I94ee39df1d571e9f25b7083a23cef4be58303562
    Related-Bug: #1566963

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/319102

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/319102
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=f8a987a0b5f9ddfeee0ae2e523a6f1f5812e67bb
Submitter: Jenkins
Branch: stable/mitaka

commit f8a987a0b5f9ddfeee0ae2e523a6f1f5812e67bb
Author: Fedor Zhadaev <email address hidden>
Date: Thu Apr 28 12:28:48 2016 +0300

    Fix Network Templates Verification for environments with DPDK nodes

    Don't check private VLAN's when there is the only node
    without DPDK.

    Change-Id: I94ee39df1d571e9f25b7083a23cef4be58303562
    Related-Bug: #1566963
    (cherry picked from commit 87f2304684d346309d3b33cdea50ac6fcc6be995 )

[Artem Panchenko (apanchenko-8)]

verified

cat /etc/fuel_build_id:
 427
cat /etc/fuel_build_number:
 427
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuel-release-9.0.0-1.mos6347.noarch
 fuel-misc-9.0.0-1.mos8415.noarch
 fuel-bootstrap-cli-9.0.0-1.mos284.noarch
 fuel-migrate-9.0.0-1.mos8415.noarch
 rubygem-astute-9.0.0-1.mos747.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8718.noarch
 network-checker-9.0.0-1.mos72.x86_64
 fuel-mirror-9.0.0-1.mos137.noarch
 fuel-openstack-metadata-9.0.0-1.mos8718.noarch
 fuel-notify-9.0.0-1.mos8415.noarch
 nailgun-mcagents-9.0.0-1.mos747.noarch
 python-fuelclient-9.0.0-1.mos319.noarch
 fuelmenu-9.0.0-1.mos270.noarch
 fuel-9.0.0-1.mos6347.noarch
 fuel-utils-9.0.0-1.mos8415.noarch
 fuel-setup-9.0.0-1.mos6347.noarch
 fuel-library9.0-9.0.0-1.mos8415.noarch
 shotgun-9.0.0-1.mos90.noarch
 fuel-agent-9.0.0-1.mos284.noarch
 fuel-ui-9.0.0-1.mos2710.noarch
 fuel-ostf-9.0.0-1.mos934.noarch
 python-packetary-9.0.0-1.mos137.noarch
 fuel-nailgun-9.0.0-1.mos8718.noarch