Juniper Openstack

[ R4.1 Netronome + Juju ] ERROR:cpld_check.py:minimum acceptable value for core.speed is 633 MHz

Bug #1794274 reported by Ankit Jain
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.1
Fix Released
High
Frikkie Scholtz
R5.0
New
High
Frikkie Scholtz
Trunk
New
High
Frikkie Scholtz

Bug Description

contrail installation failing due to the following issue:

ERROR:cpld_check.py:minimum acceptable value for core.speed is 633 MHz

root@nodei8:/etc# /opt/netronome/bin/nfp-hwinfo | grep core
core.speed=600

/opt/netronome/bin/nfp-hwinfo

nfp.interface=pci.0.0
nfp.model=0x40010010
nfp.serial=00:15:4d:12:21:fc
board.exec=bootloader.bin
uart.baud=115200
preinit.setup.version=nfp-bsp-6000-b0 (4ef1e19ba176)
pcie0.type=ep
assembly.model=lithium
assembly.partno=AMDA0096-0001
assembly.revision=06
assembly.serial=16140842
assembly.vendor=SMA
chip.serial=xxxxxxxxxxxxxx
ddr0.spd=spi:1:0:0x3F0F00
ddr1.spd=spi:1:0:0x3F0F00
ddr2.spd=none
ddr3.spd=none
ddr4.spd=none
ddr5.spd=none
emu1.type=cache
emu2.type=cache
ethm.mac=00:15:4d:12:21:fc
eth.mac=00:15:4d:12:21:fd
eth.macs=4
vpd=fis:1:0:vpd.bin
board.setup.version=nfp-bsp-6000-b0 (4ef1e19ba176)
chip.model=NFP4001
chip.revision=B0
core.speed=600
me.speed=600
arm.speed=450
chip.model.device=0x62006220
chip.identifier=0x4069916162
chip.model.hard=0x5
chip.model.soft=0x40010096
chip.route=0xc96f1e8e
chip.island=0x1001f13000112
mem.setup.version=nfp-bsp-6000-b0 (4ef1e19ba176)
ddr0.mem.size=1024
ddr1.mem.size=1024
ddr0.mem.speed=1600
ddr1.mem.speed=1600
emu0.mem.size=2048
emu0.mem.base=0x2000000000
emu1.mem.size=3
emu1.mem.base=0x9900000000
emu2.mem.size=0
emu2.mem.base=0x0
arm.mem.size=96
arm.mem.base=0x207a000000
bsp.version.primary=020028
miniloader.version=nfp-bsp-6000-b0 (f3d6ea6515af)
platform.setup.version=nfp-bsp-6000-b0 (4ef1e19ba176)
cpld.version=0x1020004
cpld.location=spi:2:2:4
bsp.version.secondary=020028
phy0.ledblink=cpld:2:2:0xd.10
phy1.ledblink=cpld:2:2:0xd.12
pmon.limit=25.0
pmon.12v=cpld:7:I:32_0:0.00249:0
pmon.3v3=static:0.54
phy0.label=0
phy0.nbi=0
phy0.port=0
phy0.lanes=1
phy0.sff=8431
phy0.pin.link=-cpld:2:2:0xd.0
phy0.pin.activity=-cpld:2:2:0xd.3
phy0.SFF-8431=ee1:0:0x50:0x0
phy0.SFF-8472=ee1:0:0x51:0x0
phy0.pin.present=-cpld:2:2:0x9.5
phy0.pin.rate_select_0=cpld:2:2:0x9.2
phy0.pin.rate_select_1=cpld:2:2:0x9.1
phy0.pin.tx_disable=cpld:2:2:0x9.4
phy0.pin.tx_fault=cpld:2:2:0x9.3
phy0.pin.rx_los=cpld:2:2:0x9.0
phy0.type=SFP+
phy0.media=X
eth0.media=X
eth0.label=0.0
eth0.phy=0
eth0.lane=0
eth0.lanes=1
eth0.mac=00:15:4d:12:21:fd
eth0.boot=1
phy1.label=1
phy1.nbi=0
phy1.port=4
phy1.lanes=1
phy1.sff=8431
phy1.pin.link=-cpld:2:2:0xd.4
phy1.pin.activity=-cpld:2:2:0xd.7
phy1.SFF-8431=ee1:1:0x50:0x0
phy1.SFF-8472=ee1:1:0x51:0x0
phy1.pin.present=-cpld:2:2:0x9.11
phy1.pin.rate_select_0=cpld:2:2:0x9.8
phy1.pin.rate_select_1=cpld:2:2:0x9.7
phy1.pin.tx_disable=cpld:2:2:0x9.10
phy1.pin.tx_fault=cpld:2:2:0x9.9
phy1.pin.rx_los=cpld:2:2:0x9.6
phy1.type=SFP+
phy1.media=X
eth1.media=X
eth1.label=1.0
eth1.phy=1
eth1.lane=0
eth1.lanes=1
eth1.mac=00:15:4d:12:21:fe
eth1.boot=1
board.state=15
m88x5113.setup.version=nfp-bsp-6000-b0 (4ef1e19ba176)
bootloader.version=nfp-bsp-6000-b0 (7e01096d5c598ab6e6a664cc7042a9d8ed14ca90)
bsp.version=020028.020028.02007c

Logs:

root@nodei8:/var/log/juju# /opt/netronome/bin/ns-vrouter-ctl start
Device "nfp_fallback" does not exist.
ERR47 kernel patch found.
Starting nfp-vrouter
Checking for running VMs
Removing kmods
Loading nfp
Loading vfio-pci
INFO:cpld_check.py:CPLD version is 0x1020004
INFO:cpld_check.py:core.speed is 600 MHz
ERROR:cpld_check.py:minimum acceptable value for core.speed is 633 MHz
ERROR:cpld_check.py:please upgrade your configurator to the latest version
root@nodei8:/var/log/juju# /opt/netronome/bin/ns-vrouter-ctexit
bash: /opt/netronome/bin/ns-vrouter-ctexit: No such file or directory

root@nodel9:/home/ubuntu# /opt/netronome/bin/nfp-hwinfo | grep core
core.speed=600

2018-09-20 11:33:15 DEBUG install python-webob python-wrapt python-yaml python-zope.interface python2.7
2018-09-20 11:33:15 DEBUG install python2.7-minimal qemu-kvm qemu-system-common qemu-system-x86 seabios
2018-09-20 11:33:15 DEBUG install xmlsec1
2018-09-20 11:33:15 DEBUG install The following packages will be upgraded:
2018-09-20 11:33:15 DEBUG install qemu-block-extra qemu-utils
2018-09-20 11:33:15 DEBUG install 2 upgraded, 227 newly installed, 0 to remove and 11 not upgraded.
2018-09-20 11:33:15 DEBUG install Need to get 38.7 MB of archives.
2018-09-20 11:33:15 DEBUG install After this operation, 200 MB of additional disk space will be used.
2018-09-20 11:33:15 DEBUG install WARNING: The following packages cannot be authenticated!
2018-09-20 11:33:15 DEBUG install python-neutronclient python-nova nova-common nova-compute-libvirt
2018-09-20 11:33:15 DEBUG install nova-compute-kvm nova-compute
2018-09-20 11:33:15 DEBUG install E: There were unauthenticated packages and -y was used without --allow-unauthenticated
2018-09-20 11:33:15 DEBUG install Traceback (most recent call last):
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/install.real", line 622, in <module>
2018-09-20 11:33:15 DEBUG install main()
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/install.real", line 615, in main
2018-09-20 11:33:15 DEBUG install hooks.execute(sys.argv)
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/charmhelpers/core/hookenv.py", line 848, in execute
2018-09-20 11:33:15 DEBUG install self._hooks[hook_name]()
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/charmhelpers/contrib/hardening/harden.py", line 79, in _harden_inner2
2018-09-20 11:33:15 DEBUG install return f(*args, **kwargs)
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/install.real", line 151, in install
2018-09-20 11:33:15 DEBUG install apt_install(determine_packages(), fatal=True)
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/charmhelpers/fetch/ubuntu.py", line 228, in apt_install
2018-09-20 11:33:15 DEBUG install _run_apt_command(cmd, fatal)
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/charmhelpers/fetch/ubuntu.py", line 588, in _run_apt_command
2018-09-20 11:33:15 DEBUG install retry_message="Couldn't acquire DPKG lock")
2018-09-20 11:33:15 DEBUG install File "/var/lib/juju/agents/unit-accel-nova-compute-1/charm/hooks/charmhelpers/fetch/ubuntu.py", line 564, in _run_with_retries
2018-09-20 11:33:15 DEBUG install result = subprocess.check_call(cmd, **kwargs)
2018-09-20 11:33:15 DEBUG install File "/usr/lib/python3.5/subprocess.py", line 581, in check_call
2018-09-20 11:33:15 DEBUG install raise CalledProcessError(retcode, cmd)
2018-09-20 11:33:15 DEBUG install subprocess.CalledProcessError: Command '['apt-get', '--assume-yes', '--option=Dpkg::Options::=--force-confold', 'install', 'nova-compute', 'genisoimage', 'librbd1', 'python-six', 'python-psutil', 'xfsprogs', 'nova-compute-kvm']' returned non-zero exit status 100
2018-09-20 11:33:15 ERROR juju.worker.uniter.operation runhook.go:113 hook "install" failed: exit status 1
2018-09-20 11:33:15 DEBUG juju.worker.uniter.operation executor.go:84 lock released
2018-09-20 11:33:15 INFO juju.worker.uniter resolver.go:100 awaiting error resolution for "install" hook
2018-09-20 11:33:15 DEBUG juju.worker.uniter agent.go:17 [AGENT-STATUS] error: hook failed: "install"
2018-09-20 11:35:40 DEBUG juju.worker.uniter.remotestate watcher.go:455 update status timer triggered
2018-09-20 11:35:40 INFO juju.worker.uniter resolver.go:100 awaiting error resolution for "install" hook
2018-09-20 11:36:46 DEBUG juju.worker.uniter.remotestate watcher.go:449 got a relation units change: {40 {map[nova-cloud-controller/0:{1}] []}}
2018-09-20 11:36:46 INFO juju.worker.uniter resolver.go:100 awaiting error resolution for "install" hook

2018-09-24 11:50:34 DEBUG install ns-agilio-vrouter is already the newest version (4.1.2.0-26).
2018-09-24 11:50:34 DEBUG install virtio-forwarder is already the newest version (1.1.99.3~ubuntu16.04).
2018-09-24 11:50:34 DEBUG install 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
2018-09-24 11:50:34 DEBUG install Device "nfp_fallback" does not exist.
2018-09-24 11:50:34 DEBUG install ERR47 kernel patch found.
2018-09-24 11:50:34 DEBUG install Starting nfp-vrouter
2018-09-24 11:50:34 DEBUG install Checking for running VMs
2018-09-24 11:50:34 DEBUG install Removing kmods
2018-09-24 11:50:35 DEBUG install Loading nfp
2018-09-24 11:50:35 DEBUG install Loading vfio-pci
2018-09-24 11:50:40 DEBUG install INFO:cpld_check.py:CPLD version is 0x1020004
2018-09-24 11:50:40 DEBUG install INFO:cpld_check.py:core.speed is 600 MHz
2018-09-24 11:50:40 DEBUG install ERROR:cpld_check.py:minimum acceptable value for core.speed is 633 MHz
2018-09-24 11:50:40 DEBUG install ERROR:cpld_check.py:please upgrade your configurator to the latest version
2018-09-24 11:50:40 DEBUG install Traceback (most recent call last):
2018-09-24 11:50:40 DEBUG install File "/var/lib/juju/agents/unit-agilio-vrouter-1/charm/hooks/install.real", line 107, in <module>
2018-09-24 11:50:40 DEBUG install main()
2018-09-24 11:50:40 DEBUG install File "/var/lib/juju/agents/unit-agilio-vrouter-1/charm/hooks/install.real", line 101, in main
2018-09-24 11:50:40 DEBUG install hooks.execute(sys.argv)
2018-09-24 11:50:40 DEBUG install File "/var/lib/juju/agents/unit-agilio-vrouter-1/charm/hooks/charmhelpers/core/hookenv.py", line 731, in execute
2018-09-24 11:50:40 DEBUG install self._hooks[hook_name]()
2018-09-24 11:50:40 DEBUG install File "/var/lib/juju/agents/unit-agilio-vrouter-1/charm/hooks/install.real", line 76, in install
2018-09-24 11:50:40 DEBUG install install_agilio()
2018-09-24 11:50:40 DEBUG install File "/var/lib/juju/agents/unit-agilio-vrouter-1/charm/hooks/install.real", line 81, in install_agilio
2018-09-24 11:50:40 DEBUG install configure_initramfs()
2018-09-24 11:50:40 DEBUG install File "/var/lib/juju/agents/unit-agilio-vrouter-1/charm/hooks/agilio_vrouter_utils.py", line 28, in configure_initramfs
2018-09-24 11:50:40 DEBUG install check_call("/opt/netronome/bin/ns-vrouter-ctl start", shell=True)
2018-09-24 11:50:40 DEBUG install File "/usr/lib/python2.7/subprocess.py", line 541, in check_call
2018-09-24 11:50:40 DEBUG install raise CalledProcessError(retcode, cmd)
2018-09-24 11:50:40 DEBUG install subprocess.CalledProcessError: Command '/opt/netronome/bin/ns-vrouter-ctl start' returned non-zero exit status 1
2018-09-24 11:50:40 ERROR juju.worker.uniter.operation runhook.go:113 hook "install" failed: exit status 1
2018-09-24 11:50:40 DEBUG juju.worker.uniter.operation executor.go:84 lock released

Ankit Jain (ankitja)
tags: added: blocker
tags: added: netronome
Ankit Jain (ankitja)
tags: added: vrouter
Sudheendra Rao (sudheendra-k)
tags: removed: vrouter
Revision history for this message
Jeba Paulaiyan (jebap) wrote :

SHould be fixed..

Jeba Paulaiyan (jebap)
tags: removed: blocker
tags: added: releasenote
Revision history for this message
Ankit Jain (ankitja) wrote :

We had some old cards flashed with old firmware installed.

Netronome ( Pieter/Mario) provided the scripts to re flash the cards with required core speed. The problem was solved after re flashing the cards with the correct version as Pieter also mentioned in the mail.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.