Ubuntu: use kernel 3.13 in Fuel 6.0

Bug #1390044 reported by Alexei Sheplyakov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Alexei Sheplyakov

Bug Description

* The lts-saucy (3.11) kernel being used at the moment is not supported by Ubuntu any more (EOLed as of Aug 2014, see https://wiki.ubuntu.com/Releases)
* Improved hardware support (for one, Intel Haswell features like P-State driver or eLLC cache are properly supported by 3.13)
* In-kernel openvswitch datapath module supports VXLAN

Changed in fuel:
assignee: nobody → Alexei Sheplyakov (asheplyakov)
milestone: none → 6.0
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/133061

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-library (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/133286

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Related fix proposed to branch: master
Review: https://review.openstack.org/133341

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/133640

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/133640
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=3eb1af76bd52ed65c2cdd6737a9209cf38af9b3f
Submitter: Jenkins
Branch: master

commit 3eb1af76bd52ed65c2cdd6737a9209cf38af9b3f
Author: Alexei Sheplyakov <email address hidden>
Date: Mon Nov 10 18:41:27 2014 +0300

    mirror-ubuntu: use the OSCI repo for bootstrapping the chroot

    If some of the base packages (like python-minimal) has been rebuilt
    we should use them when bootstrapping the temporary chroot. Otherwise
    the newly created apt repo will contain either only upstream version of
    the package in question, or both the upstream and customized versions.

    Assume that the base package X has been customized. The customized version
    of X is located on the OSCI mirror. Multistrap does not use that mirror, so
    the upstream version of X gets pulled into the apt cache (typically
    /var/apt/cache/archives) during bootstrapping of the chroot. Packages
    depending on X pull its customized version (since the OSCI repo is added
    to the sources.list.d after bootstrapping the chroot). If X is an essential
    package (so other packages are not obliged to declare dependence on X)
    only the upstream version of X gets into the apt repo being created.

    Use the OSCI mirror when bootstrapping the chroot to avoid the problem.

    While at it reduce copy-paste noise in createchroot.mk and make it a little
    bit less obscure.

    Related-bug: #1390416
    Related-bug: #1390044
    Related-bug: #1383641

    Change-Id: Ic418c760a1635d5c72cc108658d412228fb83a62

Changed in fuel:
status: New → Confirmed
importance: Undecided → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/133061
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=4009440abce43c25ab0b0e93c4b2386ef1965a98
Submitter: Jenkins
Branch: master

commit 4009440abce43c25ab0b0e93c4b2386ef1965a98
Author: Alexei Sheplyakov <email address hidden>
Date: Thu Nov 6 13:33:18 2014 +0300

    ubuntu: simplify the kernel updates

    At the moment the kernel version to be installed on Ubuntu nodes is hard
    coded in config.mk (and several other files, such as requirements-deb.txt).
    This version must coninside with the version of the kernel used by Debian
    installer (otherwise Debian installer won't be able to load any kernel
    modules which in general breaks the provisioning). As a result updating
    the kernel (say, to incorporate the upstream security fixes) requires
    a lot of manual intervention: downloading the netboot image, finding out
    the exact kernel version it uses, updating config.mk, requirements-deb.txt,
    and so on.

    This patch makes the process much simpler: updating the kernel (to a version
    provided by Ubuntu) boils down to changing the UBUNTU_KERNEL_FLAVOR
    variable (and possilby the UBUNTU_NETBOOT_FLAVOR variable).

     * config.mk: introduce UBUNTU_KERNEL_FLAVOR and UBUNTU_NETBOOT_FLAVOR
       variables. The former specifies which kernel should be installed on
       nodes, and the latter tells which netboot variant should be used.

     * image/ubuntu/module.mk: install the kernel specified by
       the UBUNTU_KERNEL_FLAVOR variable. There's no need to use exactly
       the same version of the kernel as Debian installer does, as image
       based provisioning does not use Debian installer at all.

     * mirror/ubuntu/boot.mk: guess and write the installer kernel version
       into a file which can be include'd by other modules. While at it
       reduce the copy-paste noise.

     * mkrepo.sh: make sure that the kernel (and the correspodning headers)
       (meta-)packages specified by UBUNTU_KERNEL_FLAVOR are included into
       the mirror.

    Change-Id: Ia8db615284644b0e2bcdb70c1c7bb1f4388d5e46
    Related-bug: #1390044
    Related-bug: #1383641

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/133286
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=1a1c37fb4b191c1bc61cac214544fd28b7a71e6e
Submitter: Jenkins
Branch: master

commit 1a1c37fb4b191c1bc61cac214544fd28b7a71e6e
Author: Alexei Sheplyakov <email address hidden>
Date: Fri Sep 5 20:34:15 2014 +0400

    ubuntu-1204.preseed: avoid bashisms

    Provisioning fails with kernel 3.13 because of preseed/late_command errors.
    These errors are caused by bashisms (echo -e and similar). The default shell
    in Ubuntu is dash, also bash is not available in the installer environment
    (which uses busybox shell).

    Change-Id: Ia47ffe0584424e67f173ca9467334679071053c7
    Related-bug: #1390044
    Related-bug: #1383641

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/134520

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-library (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/135677

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package openvswitch has been built for project packages/precise/openvswitch
Package version == 2.0.2, package release == ubuntu1

Changeset: https://review.fuel-infra.org/969
project: packages/precise/openvswitch
branch: 6.0
author: Alexei Sheplyakov
committer: Alexei Sheplyakov
subject: Added openvswitch 2.0.2 sources from Ubuntu 14.04.1
status: patchset-created

Files placed on repository:
openvswitch-common_2.0.2-ubuntu1_amd64.deb
openvswitch-controller_2.0.2-ubuntu1_amd64.deb
openvswitch-datapath-dkms_2.0.2-ubuntu1_all.deb
openvswitch-datapath-source_2.0.2-ubuntu1_all.deb
openvswitch-dbg_2.0.2-ubuntu1_amd64.deb
openvswitch-ipsec_2.0.2-ubuntu1_amd64.deb
openvswitch-pki_2.0.2-ubuntu1_all.deb
openvswitch-switch_2.0.2-ubuntu1_amd64.deb
openvswitch-test_2.0.2-ubuntu1_all.deb
ovsdbmonitor_2.0.2-ubuntu1_all.deb
python-openvswitch_2.0.2-ubuntu1_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0-stable-969/ubuntu

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/133341
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=64177cb8020bec42a6121b5eca2744152f58bd03
Submitter: Jenkins
Branch: master

commit 64177cb8020bec42a6121b5eca2744152f58bd03
Author: Alexei Sheplyakov <email address hidden>
Date: Sat Nov 15 16:09:54 2014 +0300

    Use in-tree openvswitch datapath module if the kernel is new enough

    The major part of the openvswitch datapath kernel module has been merged into
    Linux 3.13. In particular both GRE and VXLAN tunnels are supported (which are
    used by neutron). The out-of-tree module is no longer actively developed.
    In particular, version 1.10 and 1.11 do not support kernel newer than 3.8
    (although Debian maintainers made them work with kernels <= 3.11).

    Therefore use the out-of-tree module only with old kernels (the ones older
    than 3.13)

    Change-Id: Ic0f19bb451cb6a27ba4f17431810301414e711c3
    Related-bug: #1390044
    Related-bug: #1383641

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/134520
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=2102c176152be482e04d072f2af0afc48741ec9d
Submitter: Jenkins
Branch: master

commit 2102c176152be482e04d072f2af0afc48741ec9d
Author: Alexei Sheplyakov <email address hidden>
Date: Thu Nov 6 19:32:41 2014 +0300

    ubuntu: use kernel 3.13 (lts-trusty)

    * packages/deb/debian-boot/01_mount_target_proc.sh: the linux-image
      pre-install script uses /proc/cpuinfo to query CPU features without
      checking if /proc has been mounted. This script mounts proc in /target
      before installing the kernel itself.

    * packages/deb/debian-boot/initrd.mk: include the helper script for
      mounting /proc into initramfs.

    * config.mk: use lts-trusty (Linux 3.13) kernel and the corresponding
      netboot variant (netboot-trusty) by default.

    Change-Id: Id6a2578e36f5f303ffa05ed4d702b119964f62a4
    Related-bug: #1390044
    Related-bug: #1383641

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/135677
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=f56012302149b5d69b5cb67a3276acafa30390ae
Submitter: Jenkins
Branch: master

commit f56012302149b5d69b5cb67a3276acafa30390ae
Author: Alexei Sheplyakov <email address hidden>
Date: Sat Nov 15 16:09:54 2014 +0300

    ubuntu: use linux-image-lts-trusy (Linux 3.13)

    Change-Id: If33458231f355b27b36a31185075a686c2513f17
    Related-bug: #1390044
    Related-bug: #1383641

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-library (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/137770

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/137770
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=ce3bb61d91e7dafa72dd4281698f343961750d5f
Submitter: Jenkins
Branch: master

commit ce3bb61d91e7dafa72dd4281698f343961750d5f
Author: Vladimir Kozhukalov <email address hidden>
Date: Fri Nov 28 14:38:07 2014 +0300

    Ubuntu: using 3.11 kernel for MOS versions < 6.0

    * Added 'if' condition into ubuntu preseed so as to
      install 3.11 kernel if fuel_version is not equal to 6.0
      trusty kernel if it is.

    Change-Id: I495b1da9d4ed5effcaea32b27cd0cc0b5f527075
    Related-bug: 1390044
    Related-bug: 1383641
    Related-bug: 1348331

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package openvswitch has been built for project packages/precise/openvswitch
Package version == 2.0.2, package release == ubuntu1

Changeset: https://review.fuel-infra.org/969
project: packages/precise/openvswitch
branch: 6.0
author: Alexei Sheplyakov
committer: Alexei Sheplyakov
subject: Added openvswitch 2.0.2 sources from Ubuntu 14.04.1
status: patchset-created

Files placed on repository:
openvswitch-common_2.0.2-ubuntu1_amd64.deb
openvswitch-controller_2.0.2-ubuntu1_amd64.deb
openvswitch-datapath-dkms_2.0.2-ubuntu1_all.deb
openvswitch-datapath-source_2.0.2-ubuntu1_all.deb
openvswitch-dbg_2.0.2-ubuntu1_amd64.deb
openvswitch-ipsec_2.0.2-ubuntu1_amd64.deb
openvswitch-pki_2.0.2-ubuntu1_all.deb
openvswitch-switch_2.0.2-ubuntu1_amd64.deb
openvswitch-test_2.0.2-ubuntu1_all.deb
ovsdbmonitor_2.0.2-ubuntu1_all.deb
python-openvswitch_2.0.2-ubuntu1_all.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0-stable-969/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package openvswitch has been built for project packages/precise/openvswitch
Package version == 2.0.2, package release == ubuntu1

Changeset: https://review.fuel-infra.org/969
project: packages/precise/openvswitch
branch: 6.0
author: Alexei Sheplyakov
committer: Alexei Sheplyakov
subject: Added openvswitch 2.0.2 sources from Ubuntu 14.04.1
status: change-merged

Files placed on repository:
openvswitch-common_2.0.2-ubuntu1_amd64.deb
openvswitch-controller_2.0.2-ubuntu1_amd64.deb
openvswitch-datapath-dkms_2.0.2-ubuntu1_all.deb
openvswitch-datapath-source_2.0.2-ubuntu1_all.deb
openvswitch-dbg_2.0.2-ubuntu1_amd64.deb
openvswitch-ipsec_2.0.2-ubuntu1_amd64.deb
openvswitch-pki_2.0.2-ubuntu1_all.deb
openvswitch-switch_2.0.2-ubuntu1_amd64.deb
openvswitch-test_2.0.2-ubuntu1_all.deb
ovsdbmonitor_2.0.2-ubuntu1_all.deb
python-openvswitch_2.0.2-ubuntu1_all.deb

Changeset merged. Package placed on primary repository
DEB repository URL: http://osci-obs.vm.mirantis.net:82/ubuntu-fuel-6.0-stable/ubuntu

Changed in fuel:
status: Confirmed → Fix Committed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.