Deployment failed due installation kmod-openvswitch

Bug #1456459 reported by Nastya Urlapova
34
This bug affects 5 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
MOS Linux

Bug Description

release_versions: {
2014.2.2-6.1: {
VERSION: {
build_id: "2015-05-18_20-55-26",
build_number: "435",
api: "1.0",
fuel-library_sha: "5fd379f0cd8106808ab9fc098ca1094c7d91041a",
nailgun_sha: "7c911c09a7ed62668a6b9ad38af611b97bc64700",
feature_groups: [
"mirantis"
],
openstack_version: "2014.2.2-6.1",
production: "docker",
python-fuelclient_sha: "e19f1b65792f84c4a18b5a9473f85ef3ba172fce",
astute_sha: "96801c5bccb14aa3f2a0d7f27f4a4b6dd2b4a548",
fuel-ostf_sha: "9ce1800749081780b8b2a4a7eab6586583ffaf33",
release: "6.1",
fuelmain_sha: "68796aeaa7b669e68bc0976ffd616709c937187a"

Scenario:
            1. Create cluster
            2. Add 3 nodes with controller role
            3. Add 2 nodes with compute role
            4. Deploy the cluster
            5. Run network verification
            6. Run OSTF

Deployment failed on primary controller with error
http://pastebin.com/LyZ5j1BW

Revision history for this message
Nastya Urlapova (aurlapova) wrote :
Changed in fuel:
importance: Undecided → Critical
Revision history for this message
Ihor Kalnytskyi (ikalnytskyi) wrote :

We don't have "kmod-openvswitch" package in CentOS mirror -

    http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64/Packages/

Therefore, it's unable to install it and that's what our puppet manifests try to do -

    https://github.com/stackforge/fuel-library/blob/2814c51668f487e97e1449b078bad1942421e6b9/deployment/puppet/l23network/manifests/params.pp#L29-L31

Changed in fuel:
status: New → Triaged
Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Stanislaw Bogatkin (sbogatkin)
Revision history for this message
Dmitry Burmistrov (dburmistrov) wrote :

kmod-openvswitch has been built with wrong package names
# yum search openvsvitsh
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: centos-mirror.rbc.ru
 * extras: centos-mirror.rbc.ru
 * updates: centos-mirror.rbc.ru
Warning: No matches found for: openvsvitsh
No Matches found
[root@d44dd4c9da2a /]# yum search openvswitch
openvswitch.x86_64
openvswitch-debuginfo.x86_64
kmod-openvswitch-2.6.32-504.1.3.el6.x86_64.x86_64
kmod-openvswitch-3.10.55-1.mira6.x86_64

# yum info kmod-openvswitch-2.6.32-504.1.3.el6.x86_64
Available Packages
Name : kmod-openvswitch-2.6.32-504.1.3.el6.x86_64
Arch : x86_64
Version : 2.3.1
Release : mira1.mira2

# yum info kmod-openvswitch-3.10.55-1.mira6
Available Packages
Name : kmod-openvswitch-3.10.55-1.mira6
Arch : x86_64
Version : 2.3.1
Release : mira1.mira2

Changed in fuel:
assignee: Stanislaw Bogatkin (sbogatkin) → MOS Linux (mos-linux)
Revision history for this message
Stanislaw Bogatkin (sbogatkin) wrote :

MOS team, it would be nice to provide 2 packages with names

'kmod-openvswitch-3.10.55' and 'kmod-openvswitch-2.6.32'

I'll create patchset for that from fuel-library side.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-library (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/184220

Revision history for this message
Alex Schultz (alex-schultz) wrote :

I tried to do a centos (old kernel) deploy with #436 and there is no kmod-openvswitch so the installation fails.

[root@node-1 ~]# yum search openvswitch
Loaded plugins: fastestmirror, priorities
Loading mirror speeds from cached hostfile
=========================== N/S Matched: openvswitch ===========================
openstack-neutron-openvswitch.noarch : Neutron openvswitch plugin
openvswitch.x86_64 : Open vSwitch daemon/database/utilities

  Name and summary matches only, use "search all" for everything.

There is no kmod-openvswitch available from http://mirror.fuel-infra.org/fwm/6.1/centos/os/x86_64/Packages either.

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to packages/centos6/openvswitch-kmod (6.1)

Related fix proposed to branch: 6.1
Change author: Alexei Sheplyakov <email address hidden>
Review: https://review.fuel-infra.org/6813

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix merged to packages/centos6/openvswitch-kmod (6.1)

Reviewed: https://review.fuel-infra.org/6813
Submitter: Michael Semenov <email address hidden>
Branch: 6.1

Commit: f799fb1de6d684cb40ed150450faf747f9f3e592
Author: Alexei Sheplyakov <email address hidden>
Date: Wed May 20 08:38:05 2015

Build the datapath module for kernel-lt...

... without breaking/changing the module for the default kernel.

Related-Bug: #1456459
Change-Id: I3fb98d0cd5c0d31c502e441730e42f36b2a34d85

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/184462

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/184462
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=87d1e8bb43cfa836e441300bf494f6db05bf9249
Submitter: Jenkins
Branch: master

commit 87d1e8bb43cfa836e441300bf494f6db05bf9249
Author: Alexei Sheplyakov <email address hidden>
Date: Wed May 20 14:36:14 2015 +0300

    CentOS: include kmod-openvswitch-lt package

    So openvswitch can work with kernel 3.10.x

    Related-Bug: #1456459
    Change-Id: I646dc7b09d2c2ffbeb5771b1d5d140860e277bc0

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/184220
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=1d66413fcbd7289d56692c4c2e69456c2df81ed5
Submitter: Jenkins
Branch: master

commit 1d66413fcbd7289d56692c4c2e69456c2df81ed5
Author: Stanislaw Bogatkin <email address hidden>
Date: Tue May 19 13:34:50 2015 +0300

    Change version of kmod-openvswitch to kernel version

    As long as we should have 2 versions of kmod-openvswitch for
    every kernel, we should select right version in manifests.

    Change-Id: If6f7f7e500f4a76d79349be802d43ba479dd597f
    Related-Bug: #1456459

Revision history for this message
Alexei Sheplyakov (asheplyakov) wrote :

The kmod-openvswitch-lt package fix [1], fuel-main [2], and fuel-library [3] fixes have been merged.

[1] https://review.fuel-infra.org/6813
[2] https://review.openstack.org/184462
[3] https://review.openstack.org/184220

Marking bug as "Fix committed"

Changed in fuel:
status: Triaged → Fix Committed
tags: added: on-verification
Revision history for this message
Anastasia Palkina (apalkina) wrote :

Verified on ISO #446

"build_id": "2015-05-21_04-04-09", "build_number": "446", "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id": "2015-05-21_04-04-09", "build_number": "446", "api": "1.0", "fuel-library_sha": "a03efb582b06bfe8d9776dce244d4a2f2e2ba886", "nailgun_sha": "403c6b7ea3c62bb4fda27eb9cedee37f7144558c", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "e19f1b65792f84c4a18b5a9473f85ef3ba172fce", "astute_sha": "795f8a045400fe82ccc30ae018e85324b3fa1de5", "fuel-ostf_sha": "3dd25a018f2a5c47ec6c885436b3ba69690ef1b9", "release": "6.1", "fuelmain_sha": "5c8ebddf64ea93000af2de3ccdb4aa8bb766ce93"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "a03efb582b06bfe8d9776dce244d4a2f2e2ba886", "nailgun_sha": "403c6b7ea3c62bb4fda27eb9cedee37f7144558c", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "e19f1b65792f84c4a18b5a9473f85ef3ba172fce", "astute_sha": "795f8a045400fe82ccc30ae018e85324b3fa1de5", "fuel-ostf_sha": "3dd25a018f2a5c47ec6c885436b3ba69690ef1b9", "release": "6.1", "fuelmain_sha": "5c8ebddf64ea93000af2de3ccdb4aa8bb766ce93"

Changed in fuel:
status: Fix Committed → Fix Released
tags: removed: on-verification
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/185023

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to fuel-infra/jeepyb-config (master)

Related fix proposed to branch: master
Change author: Alexei Sheplyakov <email address hidden>
Review: https://review.fuel-infra.org/6896

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix merged to fuel-infra/jeepyb-config (master)

Reviewed: https://review.fuel-infra.org/6896
Submitter: Igor Shishkin <email address hidden>
Branch: master

Commit: 61c9dc13a12a083547468478c4e7cae4b7dd4705
Author: Alexei Sheplyakov <email address hidden>
Date: Fri May 22 14:06:07 2015

Add dmraid and parted repositories for CentOS 6

Both dmraid and parted make use of device-mapper-libs shared library.
The latter has been upgraded as a part of lvm2 upgrade, however neither
dmraid no parted has been rebuilt. As a result both dmraid and parted
are uninstallable. For now fuel-main was too permissive and accepted
such problematic packages which caused serious issues (silent removal
of kmod-openvswitch package from the fuel-infra RPM repo, etc).
Since dmraid and parted are in the @Base group excluding them is not
an option. Hence add repositories and relink them with the upgraded
device-mapper-libs.

Related-Bug: #1456459
Related-Bug: #1457382
Related-Bug: #1457871
Change-Id: Ieae7d1e50e67c618e845f93f4c27a8f420467849

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to packages/centos6/dmraid (6.1)

Related fix proposed to branch: 6.1
Change author: Alexei Sheplyakov <email address hidden>
Review: https://review.fuel-infra.org/6909

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to packages/centos6/parted (6.1)

Related fix proposed to branch: 6.1
Change author: Alexei Sheplyakov <email address hidden>
Review: https://review.fuel-infra.org/6912

Revision history for this message
Alexei Sheplyakov (asheplyakov) wrote :
Revision history for this message
Mikhail Chernik (mchernik) wrote :

I've run stability test against OVS on Neutron+GRE and Neutron+VLAN using hping3 --flood between two instances running on different nodes.

In both cases OVS was stable, ovs-vswitchd maximum CPU consumption was 0.7%

Environment:
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  openstack_version: "2014.2.2-6.1"
  api: "1.0"
  build_number: "446"
  build_id: "2015-05-21_04-04-09"
  nailgun_sha: "403c6b7ea3c62bb4fda27eb9cedee37f7144558c"
  python-fuelclient_sha: "e19f1b65792f84c4a18b5a9473f85ef3ba172fce"
  astute_sha: "795f8a045400fe82ccc30ae018e85324b3fa1de5"
  fuel-library_sha: "a03efb582b06bfe8d9776dce244d4a2f2e2ba886"
  fuel-ostf_sha: "3dd25a018f2a5c47ec6c885436b3ba69690ef1b9"

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on packages/centos6/parted (6.1)

Change abandoned by Alexei Sheplyakov <email address hidden> on branch: 6.1
Review: https://review.fuel-infra.org/6912
Reason: The updated device-mapper-libs has a compatible API and ABI

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on packages/centos6/dmraid (6.1)

Change abandoned by Alexei Sheplyakov <email address hidden> on branch: 6.1
Review: https://review.fuel-infra.org/6909
Reason: The updated device-mapper-libs has a compatible ABI and API

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.