Juniper Openstack

DPDK: Setup_interface has issues bringup bond on VF

Bug #1576533 reported by Vinod Nair
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.0
Fix Committed
High
Vinod Nair
Juniper Openstack r3.0.2.0
Trunk
Fix Committed
High
Vinod Nair

Bug Description

setup_interface is not able to bring up bond interface on VF's. Configuration wise it looks ok
some parameters like mac, vlans , spoof check etc are not set being set on the VF

root@cs-scale-1:/opt/contrail/utils# fab setup_interface
[root@10.87.141.1] Executing task 'setup_interface'
2016-04-28 23:01:35:728004: [root@10.87.141.1] sudo: setup-vnc-interfaces --device bond0 --ip 13.1.0.1/24 --members p1p1 p1p2 --bond-opts '{"xmit_hash_policy": "layer3+4", "mode": "802.3ad"}'
2016-04-28 23:01:35:728395: [root@10.87.141.1] out: cat: /proc/net/bonding/bond0: No such file or directory
2016-04-28 23:01:36:078129: [root@10.87.141.1] out: 2016-04-28 23:01:36,077:: remove_lines:INFO:: Remove Existing Interface configs in /etc/network/interfaces
2016-04-28 23:01:36:079256: [root@10.87.141.1] out: cat: /proc/net/bonding/bond0: No such file or directory
2016-04-28 23:01:36:142976: [root@10.87.141.1] out: 2016-04-28 23:01:36,114:: create_bond_members:INFO:: Create Bond Members: p1p1
2016-04-28 23:01:36:143115: [root@10.87.141.1] out: 2016-04-28 23:01:36,130:: create_bond_members:INFO:: Create Bond Members: p1p2
2016-04-28 23:01:36:143207: [root@10.87.141.1] out: 2016-04-28 23:01:36,147:: create_bonding_interface:INFO:: Creating bond master: bond0 with Mac Addr: 90:e2:ba:50:aa:dc
2016-04-28 23:01:36:150986: [root@10.87.141.1] out: 2016-04-28 23:01:39,168:: restart_service:INFO:: Restarting Network Services...
2016-04-28 23:01:39:172133: [root@10.87.141.1] out: Internet Systems Consortium DHCP Client 4.2.4
2016-04-28 23:01:39:372945: [root@10.87.141.1] out: Copyright 2004-2012 Internet Systems Consortium.
2016-04-28 23:01:39:373192: [root@10.87.141.1] out: All rights reserved.
2016-04-28 23:01:39:373353: [root@10.87.141.1] out: For info, please visit https://www.isc.org/software/dhcp/
2016-04-28 23:01:39:373510: [root@10.87.141.1] out:
2016-04-28 23:01:39:373659: [root@10.87.141.1] out: Listening on LPF/em1/c4:54:44:44:d7:26
2016-04-28 23:01:39:373804: [root@10.87.141.1] out: Sending on LPF/em1/c4:54:44:44:d7:26
2016-04-28 23:01:39:373953: [root@10.87.141.1] out: Sending on Socket/fallback
2016-04-28 23:01:39:374101: [root@10.87.141.1] out: DHCPRELEASE on em1 to 10.87.132.181 port 67 (xid=0x22f7f9b5)
2016-04-28 23:01:39:374248: [root@10.87.141.1] out: * Stopping NTP server ntpd
2016-04-28 23:01:52:197415: [root@10.87.141.1] out: ...done.
2016-04-28 23:01:52:197685: [root@10.87.141.1] out: * Starting NTP server ntpd
2016-04-28 23:01:52:197849: [root@10.87.141.1] out: ...done.
2016-04-28 23:01:52:198003: [root@10.87.141.1] out: Internet Systems Consortium DHCP Client 4.2.4
2016-04-28 23:01:52:198153: [root@10.87.141.1] out: Copyright 2004-2012 Internet Systems Consortium.
2016-04-28 23:01:52:198306: [root@10.87.141.1] out: All rights reserved.
2016-04-28 23:01:52:198456: [root@10.87.141.1] out: For info, please visit https://www.isc.org/software/dhcp/
2016-04-28 23:01:52:198610: [root@10.87.141.1] out:
2016-04-28 23:01:52:198774: [root@10.87.141.1] out: Listening on LPF/em1/c4:54:44:44:d7:26
2016-04-28 23:01:52:198923: [root@10.87.141.1] out: Sending on LPF/em1/c4:54:44:44:d7:26
2016-04-28 23:01:52:199134: [root@10.87.141.1] out: Sending on Socket/fallback
2016-04-28 23:01:52:199288: [root@10.87.141.1] out: DHCPDISCOVER on em1 to 255.255.255.255 port 67 interval 3 (xid=0x33218fcd)
2016-04-28 23:01:52:199469: [root@10.87.141.1] out: DHCPDISCOVER on em1 to 255.255.255.255 port 67 interval 8 (xid=0x33218fcd)
2016-04-28 23:01:52:199628: [root@10.87.141.1] out: DHCPDISCOVER on em1 to 255.255.255.255 port 67 interval 9 (xid=0x33218fcd)
2016-04-28 23:01:52:199784: [root@10.87.141.1] out: DHCPREQUEST of 10.87.141.1 on em1 to 255.255.255.255 port 67 (xid=0x33218fcd)
2016-04-28 23:01:52:199936: [root@10.87.141.1] out: DHCPOFFER of 10.87.141.1 from 10.87.132.181
2016-04-28 23:01:52:200086: [root@10.87.141.1] out: DHCPACK of 10.87.141.1 from 10.87.132.181
2016-04-28 23:01:52:200235: [root@10.87.141.1] out: * Stopping NTP server ntpd
2016-04-28 23:01:52:200421: [root@10.87.141.1] out: ...done.
2016-04-28 23:01:52:200571: [root@10.87.141.1] out: * Starting NTP server ntpd
2016-04-28 23:01:54:205614: [root@10.87.141.1] out: ...done.
2016-04-28 23:01:54:213328: [root@10.87.141.1] out: bound to 10.87.141.1 -- renewal in 10740 seconds.
2016-04-28 23:01:54:229182: [root@10.87.141.1] out: Waiting for bonding kernel module to be ready (will timeout after 5s)
2016-04-28 23:01:54:429815: [root@10.87.141.1] out: Waiting for bond master bond0 to be ready
2016-04-28 23:01:54:430137: [root@10.87.141.1] out:
2016-04-28 23:02:00:404421:
2016-04-28 23:02:00:404965: [root@10.87.141.2] sudo: echo 7 > /sys/class/net/p1p1/device/sriov_numvfs
2016-04-28 23:02:00:405473: [root@10.87.141.2] sudo: sed -i '/^\s*exit/i echo 7 > /sys/class/net/p1p1/device/sriov_numvfs' /etc/rc.local
2016-04-28 23:02:01:032592: [root@10.87.141.2] sudo: echo 7 > /sys/class/net/p1p2/device/sriov_numvfs
2016-04-28 23:02:01:319337: [root@10.87.141.2] sudo: sed -i '/^\s*exit/i echo 7 > /sys/class/net/p1p2/device/sriov_numvfs' /etc/rc.local
2016-04-28 23:02:01:919248: [root@10.87.141.2] sudo: setup-vnc-interfaces --device bond0 --ip 13.1.0.2/24 --members p1p1_4 p1p2_4 --bond-opts '{"mode": "balance-rr"}' --vlan 141
2016-04-28 23:02:02:085401: [root@10.87.141.2] out: cat: /proc/net/bonding/bond0: No such file or directory
2016-04-28 23:02:02:653389: [root@10.87.141.2] out: 2016-04-28 23:02:02,650:: remove_lines:INFO:: Remove Existing Interface configs in /etc/network/interfaces
2016-04-28 23:02:02:653613: [root@10.87.141.2] out: cat: /proc/net/bonding/bond0: No such file or directory
2016-04-28 23:02:02:717808: [root@10.87.141.2] out: 2016-04-28 23:02:02,696:: create_bond_members:INFO:: Create Bond Members: p1p1_4
2016-04-28 23:02:02:718079: [root@10.87.141.2] out: 2016-04-28 23:02:02,726:: create_bond_members:INFO:: Create Bond Members: p1p2_4
2016-04-28 23:02:02:725883: [root@10.87.141.2] out: 2016-04-28 23:02:02,749:: create_bonding_interface:INFO:: Creating bond master: bond0 with Mac Addr: 82:f0:35:d4:9c:e0
2016-04-28 23:02:02:757671: [root@10.87.141.2] out: 2016-04-28 23:02:05,792:: restart_service:INFO:: Restarting Network Services...
2016-04-28 23:02:05:795206: [root@10.87.141.2] out: Internet Systems Consortium DHCP Client 4.2.4
2016-04-28 23:02:05:995962: [root@10.87.141.2] out: Copyright 2004-2012 Internet Systems Consortium.
2016-04-28 23:02:05:996228: [root@10.87.141.2] out: All rights reserved.
2016-04-28 23:02:05:996439: [root@10.87.141.2] out: For info, please visit https://www.isc.org/software/dhcp/
2016-04-28 23:02:05:996584: [root@10.87.141.2] out:
2016-04-28 23:02:05:996723: [root@10.87.141.2] out: Listening on LPF/em1/c4:54:44:44:d5:be
2016-04-28 23:02:06:004675: [root@10.87.141.2] out: Sending on LPF/em1/c4:54:44:44:d5:be
2016-04-28 23:02:06:004900: [root@10.87.141.2] out: Sending on Socket/fallback
2016-04-28 23:02:06:005048: [root@10.87.141.2] out: DHCPRELEASE on em1 to 10.87.132.181 port 67 (xid=0x6beb8150)
2016-04-28 23:02:06:005188: [root@10.87.141.2] out: * Stopping NTP server ntpd
2016-04-28 23:02:19:644242: [root@10.87.141.2] out: ...done.
2016-04-28 23:02:19:644946: [root@10.87.141.2] out: * Starting NTP server ntpd
2016-04-28 23:02:19:645919: [root@10.87.141.2] out: ...done.
2016-04-28 23:02:19:646624: [root@10.87.141.2] out: Internet Systems Consortium DHCP Client 4.2.4
2016-04-28 23:02:19:646984: [root@10.87.141.2] out: Copyright 2004-2012 Internet Systems Consortium.
2016-04-28 23:02:19:647473: [root@10.87.141.2] out: All rights reserved.
2016-04-28 23:02:19:647936: [root@10.87.141.2] out: For info, please visit https://www.isc.org/software/dhcp/
2016-04-28 23:02:19:648391: [root@10.87.141.2] out:
2016-04-28 23:02:19:648548: [root@10.87.141.2] out: Listening on LPF/em1/c4:54:44:44:d5:be
2016-04-28 23:02:19:649333: [root@10.87.141.2] out: Sending on LPF/em1/c4:54:44:44:d5:be
2016-04-28 23:02:19:649507: [root@10.87.141.2] out: Sending on Socket/fallback
2016-04-28 23:02:19:649662: [root@10.87.141.2] out: DHCPDISCOVER on em1 to 255.255.255.255 port 67 interval 3 (xid=0x5979a128)
2016-04-28 23:02:19:649816: [root@10.87.141.2] out: DHCPDISCOVER on em1 to 255.255.255.255 port 67 interval 8 (xid=0x5979a128)
2016-04-28 23:02:19:650011: [root@10.87.141.2] out: DHCPDISCOVER on em1 to 255.255.255.255 port 67 interval 20 (xid=0x5979a128)
2016-04-28 23:02:19:650167: [root@10.87.141.2] out: DHCPREQUEST of 10.87.141.2 on em1 to 255.255.255.255 port 67 (xid=0x5979a128)
2016-04-28 23:02:19:650326: [root@10.87.141.2] out: DHCPOFFER of 10.87.141.2 from 10.87.132.181
2016-04-28 23:02:19:650573: [root@10.87.141.2] out: DHCPACK of 10.87.141.2 from 10.87.132.181
2016-04-28 23:02:19:650721: [root@10.87.141.2] out: * Stopping NTP server ntpd
2016-04-28 23:02:19:650868: [root@10.87.141.2] out: ...done.
2016-04-28 23:02:19:651016: [root@10.87.141.2] out: * Starting NTP server ntpd
2016-04-28 23:02:21:656721: [root@10.87.141.2] out: ...done.
2016-04-28 23:02:21:664670: [root@10.87.141.2] out: bound to 10.87.141.2 -- renewal in 8568 seconds.
2016-04-28 23:02:21:680617: [root@10.87.141.2] out: Waiting for bonding kernel module to be ready (will timeout after 5s)
2016-04-28 23:02:22:382382: [root@10.87.141.2] out: Waiting for bond master bond0 to be ready
2016-04-28 23:02:22:382626: [root@10.87.141.2] out: Failed to enslave p1p1_4 to bond0. Is bond0 ready and a bonding interface ?
2016-04-28 23:02:22:483266: [root@10.87.141.2] out: Failed to enslave p1p2_4 to bond0. Is bond0 ready and a bonding interface ?
2016-04-28 23:02:22:647579: [root@10.87.141.2] out: Set name-type for VLAN subsystem. Should be visible in /proc/net/vlan/config
2016-04-28 23:02:22:811869: [root@10.87.141.2] out: ERROR: trying to add VLAN #141 to IF -:bond0:- error: Operation not supported
2016-04-28 23:02:22:812079: [root@10.87.141.2] out: Cannot find device "bond0.141"
2016-04-28 23:02:22:812199: [root@10.87.141.2] out: Failed to bring up bond0.141.
2016-04-28 23:02:22:812343: [root@10.87.141.2] out:
2016-04-28 23:02:27:884981:
2016-04-28 23:02:27:885500:

#OPTIONAL BONDING CONFIGURATION
#==============================
#Inferface Bonding
bond= {
         host1 : { 'name': 'bond0', 'member': ['p1p1','p1p2'], 'mode': '802.3ad', 'xmit_hash_policy': 'layer3+4' },
         host2 : { 'name': 'bond0', 'member': ['p1p1_4','p1p2_4'], 'mode': 'balance-rr'},
}

#OPTIONAL SEPARATION OF MANAGEMENT AND CONTROL + DATA
#====================================================
#Control Interface
control_data = {
    host1 : { 'ip': '13.1.0.1/24', 'gw' : '13.1.0.254', 'device':'bond0' },
    host2 : { 'ip': '13.1.0.2/24', 'gw' : '13.1.0.254', 'device':'bond0','vlan': '141'}

}

root@cs-scale-2:~# ip link show dev p1p1
3: p1p1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:50:ae:d8 brd ff:ff:ff:ff:ff:ff
    vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 4 MAC 82:f0:35:d4:9c:e0, spoof checking on, link-state auto
    vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
root@cs-scale-2:~# ip link show dev p1p2
5: p1p2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 90:e2:ba:50:ae:d9 brd ff:ff:ff:ff:ff:ff
    vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 1 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 2 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 3 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 4 MAC 4e:3a:d5:9c:7d:8b, spoof checking on, link-state auto
    vf 5 MAC 00:00:00:00:00:00, spoof checking on, link-state auto
    vf 6 MAC 00:00:00:00:00:00, spoof checking on, link-state auto

Tags: dpdk
Jeba Paulaiyan (jebap)
information type: Proprietary → Public
tags: added: blocker
Revision history for this message
Raja Sivaramakrishnan (raja-u) wrote :

Fixed in https://bugs.launchpad.net/juniperopenstack/+bug/1573255

Revision history for this message
Raja Sivaramakrishnan (raja-u) wrote :

Vinod, please remove blocker tag if it looks ok.

Revision history for this message
Vinod Nair (vinodnair) wrote :

Verified with build 3.0.2 Build 43 kilo

tags: removed: blocker
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.