Mellanox OFED drivers are broken on ubuntu

[Gil Meir]

This issue is the same as this one: https://bugs.launchpad.net/bugs/1393414, but only for ubuntu.
The kernel version during ubuntu installation is 3.11.0-18-generic, where 3.11.0-24-generic is installed and later used.
OFED is compiled and installed on the first kernel, so it doesn't work after rebooting with the second kernel.

[Dmitry Borodaenko (angdraug)]

We have updated the Ubuntu kernel in 5.1.1 over the weekend, so if this bug is confirmed in 6.0 it's likely to also be present in 5.1.1.

[Aleksander Mogylchenko (amogylchenko)]

Similar to:
https://bugs.launchpad.net/bugs/1393414

we should use new kernel during all stages of the bootstrap process.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/5.1
Review: https://review.openstack.org/137189

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/137189
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=bcf461006598517c9e136867b36468c8c1526967
Submitter: Jenkins
Branch: stable/5.1

commit bcf461006598517c9e136867b36468c8c1526967
Author: Dmitry Burmistrov <email address hidden>
Date: Tue Nov 25 23:08:10 2014 +0300

    Add linux-headers-3.11.0-26-generic package to the requirements-deb

    Change-Id: I474a0c72cfa91978f226e990dd4bafa5d08bab39
    Related-Bug: #1396020

[Mike Scherbakov (mihgen)]

Assigned to Gil, as we need to identify further steps. According to the email exchange, we need some puppet modules modification.

[Gil Meir (gilmeir-d)]

I'm on it.
I verified the workaround, I'm preparing the puppet code, I believe I'll be able to push them during the next few hours.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/5.1
Review: https://review.openstack.org/137402

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/137421

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/5.1
Review: https://review.openstack.org/137432

[OpenStack Infra (hudson-openstack)]

Change abandoned by Gil Meir (<email address hidden>) on branch: stable/5.1
Review: https://review.openstack.org/137402
Reason: Committed again in the correct order: first to branch master: https://review.openstack.org/#/c/137421/ and then cherry-picked to stable/5.1: https://review.openstack.org/#/c/137432/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/137421
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=438dd6b2baf3415f487ed8f269219414b4a0db34
Submitter: Jenkins
Branch: master

commit 438dd6b2baf3415f487ed8f269219414b4a0db34
Author: gilmeir <email address hidden>
Date: Wed Nov 26 18:14:18 2014 +0200

    Recompiling Mellanox OFED drivers on Ubuntu nodes using dkms

    Recompilation is needed since the drivers are compiled and
    installed during Ubuntu installation on one kernel, but are
    later used on a different kernel version.

    Change-Id: I1fc4b7bf5603991a302e3ef145be57dd2f36e693
    Closes-bug: 1396020
    Signed-off-by: gilmeir <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/137432
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=15a387462f7be50c4f87ad986d0c81535025c125
Submitter: Jenkins
Branch: stable/5.1

commit 15a387462f7be50c4f87ad986d0c81535025c125
Author: gilmeir <email address hidden>
Date: Wed Nov 26 18:14:18 2014 +0200

    Recompiling Mellanox OFED drivers on Ubuntu nodes using dkms

    Recompilation is needed since the drivers are compiled and
    installed during Ubuntu installation on one kernel, but are
    later used on a different kernel version.

    Change-Id: I1fc4b7bf5603991a302e3ef145be57dd2f36e693
    Closes-bug: 1396020
    Signed-off-by: gilmeir <email address hidden>