SRIOV: Need to have provision task to enable SRIOV

Bug #1530478 reported by Vinod Nair
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
Trunk
Fix Committed
Critical
Divakar Dharanalakota

Bug Description

Neeed t have provision task to enable SRIOV on a node.

The needs are as below ( nneds to be defined in testbed)

1) Enable Intel IOMMU on linux like below
   1.1) In /etc/default/grub, GRUB_CMDLINE_LINUX_DEFAULT="nomdmonddf nomdmonisw intel_iommu=on"
   1.2) update-grubls /sys
   1.3) Reboot the compute node

2) Enable the required number of VF's on the required NIC ( cab be tackden from testbed
   echo '7' > /sys/class/net/eth0/device/sriov_numvfs

   This enables 7 VF's on 'eth0' interface, which can be observed on 'lspci -nn' or 'ip link'

2) Config file changes
----------------------

1) Nova compute config file changes

   1.1) Configure the physical network names whose VM's can use interface VF's in (/etc/nova/nova.conf)

        [default]
        pci_passthrough_whitelist = { "devname": "eth0", "physical_network": "physnet1"}

        The above configuration allows the VM's attached to "physnet2" to use "eth0"s VF's.

   1.2) Reboot nova compute (service nova-compute restart)

2) Nova scheduler config file changes

   2.1) Configure new Nova Scheduler filter which choses compute nodes based on above PCI config (in /etc/nova/nova.conf)

        [default]
        scheduler_default_filters = PciPassthroughFilter
        scheduler_available_filters = nova.scheduler.filters.all_filters
        scheduler_available_filters = nova.scheduler.filters.pci_passthrough_filter.PciPassthroughFilter

   2.2) Restart nova scheduler (service nova-scheduler restart)

Tags: sriov
Vinod Nair (vinodnair)
Changed in juniperopenstack:
milestone: none → r3.0-fcs
summary: - SRIOV: Neee to have provision task to enable SRIOV
+ SRIOV: Need to have provision task to enable SRIOV
information type: Proprietary → Public
Changed in juniperopenstack:
assignee: Nagendra Prasath (npchandran) → Divakar Dharanalakota (ddivakar)
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/16270
Submitter: Divakar Dharanalakota (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/16271
Submitter: Divakar Dharanalakota (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/16270
Submitter: Divakar Dharanalakota (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/16271
Committed: http://github.org/Juniper/contrail-fabric-utils/commit/54a2fc020ad9f0022dbcf2df1a2ec81a41c84f75
Submitter: Zuul
Branch: master

commit 54a2fc020ad9f0022dbcf2df1a2ec81a41c84f75
Author: Divakar <email address hidden>
Date: Wed Jan 13 11:02:25 2016 -0800

Fab changes for SRIOV

The changes contain new stanzas in testbed.py for SRIOV support and
corresponding changes to supply the configured SRIOV values to
provisioning changes.

Change-Id: I3dfe77507e1f98ff575fedec4ded2a95ba7cd94c
partial-bug: #1530478

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/16270
Committed: http://github.org/Juniper/contrail-provisioning/commit/b3133c535f00fbaabb8a77709047089404243b0a
Submitter: Zuul
Branch: master

commit b3133c535f00fbaabb8a77709047089404243b0a
Author: Divakar <email address hidden>
Date: Wed Jan 13 10:53:11 2016 -0800

SRIOV provisioning changes

The changes provide the support of configuring the Grub with Intel IOMMU
option and enabling the required number of VF's on the physical
interface and configuring the nova.conf with required parameters.

Change-Id: I56efbf5e2c9332103a6acd9fe2427bcd67cc57e4
partial-bug: #1530478

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/16670
Submitter: Divakar Dharanalakota (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/16670
Committed: http://github.org/Juniper/contrail-provisioning/commit/b92cca7196e673a0fedf45e3a97088632cf1eea3
Submitter: Zuul
Branch: master

commit b92cca7196e673a0fedf45e3a97088632cf1eea3
Author: Divakar <email address hidden>
Date: Fri Jan 29 04:07:46 2016 -0800

Fixing the nova.conf SRIOV pci white list

The previous provisioning changes for SRIOV are writing pci white list
data to nova-compute.conf and the parsing of ctl-details file was also
wrong. Now the parsing is of ctrl-details is also fixed and is written
to nova.conf

Change-Id: I7390974ab6e84f3c6caa74ef117ac4bcc243a34b
partial-bug: #1530478

Revision history for this message
Divakar Dharanalakota (ddivakar) wrote :

All the partial fixes together the provisioning is complete for sriov. Along with provisioning, the fab changes also are part of the checkins.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.