5.0: Kolla-ansible DPDK with Fortville not coming up

Bug #1762798 reported by Vinod Nair
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R5.0
Fix Committed
Critical
Jeya ganesh babu J
Trunk
Fix Committed
Critical
Jeya ganesh babu J

Bug Description

DPDK On Fortville is not coming up

5.1.0-56.el7.centos

 device 0000:81:00.1 for driver uio_pci_generic ... 58
INFO: Waiting device 0000:81:00.1 for driver uio_pci_generic ... 59
INFO: Waiting device 0000:81:00.1 for driver uio_pci_generic ... 60
INFO: exec '/bin/taskset 0xfc /usr/bin/contrail-vrouter-dpdk --no-daemon --socket-mem 1024,1024 --vlan_tci 25 --vlan_fwd_intf_name bond0 --vdev eth_bond_bond0.25,mode=2,xmit_policy=l34,socket_id=1,mac=90:e2:ba:d9:24:28,slave=0000:81:00.0,slave=0000:81:00.1'
2018-04-10 08:46:52,920 VROUTER: vRouter version: {"build-info": [{"build-time": "2018-04-09 08:52:13.632953", "build-hostname": "centos-7-4-builder-juniper-contrail-ci-0000027817", "build-user": "zuul", "build-version": "5.1.0"}]}
2018-04-10 08:46:52,920 VROUTER: DPDK version: DPDK 17.11.0
2018-04-10 08:46:52,968 VROUTER: Using VLAN TCI: 25
2018-04-10 08:46:52,968 VROUTER: Bridge Table limit: 262144
2018-04-10 08:46:52,968 VROUTER: Bridge Table overflow limit: 53248
2018-04-10 08:46:52,968 VROUTER: Flow Table limit: 524288
2018-04-10 08:46:52,968 VROUTER: Flow Table overflow limit: 105472
2018-04-10 08:46:52,968 VROUTER: MPLS labels limit: 5120
2018-04-10 08:46:52,968 VROUTER: Nexthops limit: 65536
2018-04-10 08:46:52,968 VROUTER: VRF tables limit: 4096
2018-04-10 08:46:52,968 VROUTER: Packet pool size: 16383
2018-04-10 08:46:52,968 VROUTER: Maximum packet size: 9216
2018-04-10 08:46:52,968 VROUTER: EAL arguments:
2018-04-10 08:46:52,968 VROUTER: -n "4"
2018-04-10 08:46:52,968 VROUTER: --socket-mem "1024,1024"
2018-04-10 08:46:52,968 VROUTER: --vdev "eth_bond_bond0.25,mode=2,xmit_policy=l34,socket_id=1,mac=90:e2:ba:d9:24:28,slave=0000:81:00.0,slave=0000:81:00.1"
2018-04-10 08:46:52,968 VROUTER: --lcores "(0-2)@(0-39),(8-9)@(0-39),10@2,11@3,12@4,13@5,14@6,15@7"
2018-04-10 08:46:52,971 EAL: Detected 40 lcore(s)
2018-04-10 08:46:53,015 EAL: No free hugepages reported in hugepages-1048576kB
2018-04-10 08:46:53,017 EAL: Probing VFIO support...
2018-04-10 08:47:23,827 EAL: PCI device 0000:01:00.0 on NUMA socket 0
2018-04-10 08:47:23,827 EAL: probe driver: 8086:1521 net_e1000_igb
2018-04-10 08:47:23,827 EAL: PCI device 0000:01:00.1 on NUMA socket 0
2018-04-10 08:47:23,827 EAL: probe driver: 8086:1521 net_e1000_igb
2018-04-10 08:47:23,827 EAL: PCI device 0000:02:00.0 on NUMA socket 0
2018-04-10 08:47:23,827 EAL: probe driver: 8086:10fb net_ixgbe
2018-04-10 08:47:23,827 EAL: PCI device 0000:02:00.1 on NUMA socket 0
2018-04-10 08:47:23,827 EAL: probe driver: 8086:10fb net_ixgbe
2018-04-10 08:47:23,827 EAL: PCI device 0000:81:00.0 on NUMA socket 1
2018-04-10 08:47:23,827 EAL: probe driver: 8086:158b net_i40e
2018-04-10 08:47:23,827 EAL: PCI device 0000:81:00.1 on NUMA socket 1
2018-04-10 08:47:23,827 EAL: probe driver: 8086:158b net_i40e
2018-04-10 08:47:23,827 EAL: Initializing pmd_bond for eth_bond_bond0.25
2018-04-10 08:47:23,827 EAL: Create bonded device eth_bond_bond0.25 on port 0 in mode 2 on socket 1.
2018-04-10 08:47:23,837 VROUTER: Found 1 eth device(s)
2018-04-10 08:47:23,837 VROUTER: Using 6 forwarding lcore(s)
2018-04-10 08:47:23,837 VROUTER: Using 0 IO lcore(s)
2018-04-10 08:47:23,838 VROUTER: Using 5 service lcores
2018-04-10 08:47:23,838 VROUTER: Max HOLD flow entries set to 1000
2018-04-10 08:47:23,838 VROUTER: set fd limit to 4864 (prev 65536, max 65536)
2018-04-10 08:47:23,851 VROUTER: Adding VLAN forwarding interface bond0
2018-04-10 08:47:23,851 VROUTER: KNI is not available
2018-04-10 08:47:23,851 VROUTER: creating TAP device bond0
2018-04-10 08:47:23,868 VROUTER: Starting NetLink...
2018-04-10 08:47:23,869 VROUTER: Lcore 10: distributing MPLSoGRE packets to [10,11,12,13,15]
2018-04-10 08:47:23,869 VROUTER: Lcore 11: distributing MPLSoGRE packets to [10,11,12,13,15]
2018-04-10 08:47:23,869 VROUTER: Lcore 12: distributing MPLSoGRE packets to [10,11,12,13,15]
2018-04-10 08:47:23,869 UVHOST: Starting uvhost server...
2018-04-10 08:47:23,870 USOCK: usock_alloc[7fd19a3a0700]: new socket FD 50
UVHOST: server event FD is 51
2018-04-10 08:47:23,870 VROUTER: Lcore 15: distributing MPLSoGRE packets to [10,11,12,13,15]
USOCK: usock_alloc[7fd19a3a0700]: setting socket FD 50 send buff size.
Buffer size set to 18320000 (requested 9216000)
2018-04-10 08:47:23,870 VROUTER: Lcore 13: distributing MPLSoGRE packets to [10,11,12,13,15]
2018-04-10 08:47:23,870 VROUTER: Lcore 14: distributing MPLSoGRE packets to [10,11,12,13,15]
2018-04-10 08:47:23,870 VROUTER: NetLink TCP socket FD is 50
2018-04-10 08:47:23,870 UVHOST: server socket FD is 52
2018-04-10 08:47:23,870 VROUTER: uvhost Unix socket FD is 53
2018-04-10 08:47:23,870 UVHOST: Handling connection FD 52...
2018-04-10 08:47:23,870 UVHOST: FD 52 accepted new NetLink connection FD 54
2018-04-10 08:47:26,756 VROUTER: Adding vif 0 (gen. 1) eth device 0 (PMD) MAC 00:00:00:00:00:00 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:26,756 VROUTER: Using 64 TX queues, 6 RX queues
2018-04-10 08:47:26,757 PMD: bond_ethdev_parse_slave_port_kvarg(166) - Invalid slave port value (0000:81:00.0) specified
2018-04-10 08:47:26,757 EAL: Failed to parse slave ports for bonded device eth_bond_bond0.25
2018-04-10 08:47:26,757 VROUTER: error configuring eth dev 0: Operation not permitted (1)
2018-04-10 08:47:26,757 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:26,757 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:27,148 VROUTER: Adding vif 0 (gen. 2) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:27,148 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:27,148 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:27,148 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:27,634 VROUTER: Adding vif 0 (gen. 3) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:27,634 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:27,634 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:27,634 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:28,307 VROUTER: Adding vif 0 (gen. 4) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:28,307 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:28,307 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:28,307 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:29,402 VROUTER: Adding vif 0 (gen. 5) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:29,402 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:29,402 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:29,402 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:31,289 VROUTER: Adding vif 0 (gen. 6) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:31,289 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:31,289 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:31,289 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:34,775 VROUTER: Adding vif 0 (gen. 7) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:34,775 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:34,775 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:34,775 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:41,454 VROUTER: Adding vif 0 (gen. 8) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:41,454 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:41,454 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:41,454 VROUTER: error deleting eth dev: already removed
2018-04-10 08:47:54,538 VROUTER: Adding vif 0 (gen. 9) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:47:54,538 VROUTER: error adding eth dev 0: already added
2018-04-10 08:47:54,538 VROUTER: Deleting vif 0 eth device
2018-04-10 08:47:54,538 VROUTER: error deleting eth dev: already removed
2018-04-10 08:48:20,422 VROUTER: Adding vif 0 (gen. 10) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:48:20,422 VROUTER: error adding eth dev 0: already added
2018-04-10 08:48:20,422 VROUTER: Deleting vif 0 eth device
2018-04-10 08:48:20,422 VROUTER: error deleting eth dev: already removed
2018-04-10 08:49:11,909 VROUTER: Adding vif 0 (gen. 11) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:49:11,909 VROUTER: error adding eth dev 0: already added
2018-04-10 08:49:11,909 VROUTER: Deleting vif 0 eth device
2018-04-10 08:49:11,909 VROUTER: error deleting eth dev: already removed
2018-04-10 08:50:54,596 VROUTER: Adding vif 0 (gen. 12) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:50:54,596 VROUTER: error adding eth dev 0: already added
2018-04-10 08:50:54,596 VROUTER: Deleting vif 0 eth device
2018-04-10 08:50:54,596 VROUTER: error deleting eth dev: already removed
2018-04-10 08:54:19,683 VROUTER: Adding vif 0 (gen. 13) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 08:54:19,683 VROUTER: error adding eth dev 0: already added
2018-04-10 08:54:19,683 VROUTER: Deleting vif 0 eth device
2018-04-10 08:54:19,683 VROUTER: error deleting eth dev: already removed
2018-04-10 09:01:09,581 VROUTER: Adding vif 0 (gen. 14) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 09:01:09,581 VROUTER: error adding eth dev 0: already added
2018-04-10 09:01:09,581 VROUTER: Deleting vif 0 eth device
2018-04-10 09:01:09,581 VROUTER: error deleting eth dev: already removed
2018-04-10 09:14:49,099 VROUTER: Adding vif 0 (gen. 15) eth device 0 (PMD) MAC 90:e2:ba:d9:24:28 (vif MAC 90:e2:ba:d9:24:28)
2018-04-10 09:14:49,099 VROUTER: error adding eth dev 0: already added
2018-04-10 09:14:49,099 VROUTER: Deleting vif 0 eth device

Tags: dpdk
Vinod Nair (vinodnair)
information type: Proprietary → Public
Vineet Gupta (vineetrf)
Changed in juniperopenstack:
assignee: Raja Sivaramakrishnan (raja-u) → Jeya ganesh babu J (jjeya)
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/42163
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R5.0

Review in progress for https://review.opencontrail.org/42164
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/42163
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R5.0

Review in progress for https://review.opencontrail.org/42164
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/42163
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Review in progress for https://review.opencontrail.org/42225
Submitter: Jeya ganesh babu (<email address hidden>)

Jeba Paulaiyan (jebap)
summary: - 5.0: Kolla-anible DPDK with Fortville not coming up
+ 5.0: Kolla-ansible DPDK with Fortville not coming up
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R5.0

Review in progress for https://review.opencontrail.org/42305
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/42225
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R5.0

Review in progress for https://review.opencontrail.org/42305
Submitter: Jeya ganesh babu (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/42305
Committed: http://github.com/Juniper/contrail-ansible-deployer/commit/5eceeb4b6af9b293b356b6fcedc75bc8391fb6d2
Submitter: Zuul v3 CI (<email address hidden>)
Branch: R5.0

commit 5eceeb4b6af9b293b356b6fcedc75bc8391fb6d2
Author: Jeya ganesh babu J <email address hidden>
Date: Thu Apr 19 16:36:41 2018 -0700

Support for Forville nic

Closes-bug: #1762798
Forville nic needs vfio-pci module to work, which requires
iommu to be enabled in the kernel. Changed the configure code
to setup iommu in grub for dpdk in addtion to sriov if the
driver is set to vfio-pci/vfio_pci

Change-Id: I89fbdb242db14cf868a506beeddc00624aa9ab09

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/42225
Committed: http://github.com/Juniper/contrail-ansible-deployer/commit/58ff70743929044b72a588917f2dacb1e18f2b6f
Submitter: Zuul v3 CI (<email address hidden>)
Branch: master

commit 58ff70743929044b72a588917f2dacb1e18f2b6f
Author: Jeya ganesh babu J <email address hidden>
Date: Thu Apr 19 16:36:41 2018 -0700

Support for Forville nic

Closes-bug: #1762798
Forville nic needs vfio-pci module to work, which requires
iommu to be enabled in the kernel. Changed the configure code
to setup iommu in grub for dpdk in addtion to sriov if the
driver is set to vfio-pci/vfio_pci

Change-Id: I89fbdb242db14cf868a506beeddc00624aa9ab09

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.