IPMI USB SCSI endpoint discovery can fail on OpenPower machines
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| | ipmitool (Ubuntu) |
Medium
|
Mathieu Trudel-Lapierre | ||
| | Trusty |
Medium
|
Mathieu Trudel-Lapierre | ||
| | Vivid |
Medium
|
Mathieu Trudel-Lapierre | ||
| | Wily |
Medium
|
Mathieu Trudel-Lapierre | ||
Bug Description
[Impact]
The current ipmitool code can fail to find an IPMI device on my OpenPower machine, due to bug in the USB SCSI device discovery process.
This will only happen if the user has adjusted the number of virtual USB devices that the BMC exports. However, the failure mode isn't obvious, and it prevents the user from using the 'USB' IPMI channel, which is required for firmware upgrades.
This is fixed in upstream commit 607cfe6f4, can we backport this to the Ubuntu ipmitool for versions at 1.8.15 or earlier?
[Test case]
1- Increase number of virtual USB devices exported by BMC
2- Run ipmitool -I usb lan print
[Regression Potential]
Low potential for regression. This increases the number of devices allowed for SCSI; since following spec there may be up to 16 devices on a bus. This might cause issues still for out of spec systems with more devices on the bus, or buggy BIOS incorrectly cleaning up memory for devices that are not present (ie. non-zeroed memory that could make ipmi think there is a device when there is not).
| Changed in ipmitool (Ubuntu): | |
| assignee: | nobody → Taco Screen team (taco-screen-team) |
| Changed in ipmitool (Ubuntu): | |
| assignee: | Taco Screen team (taco-screen-team) → Mathieu Trudel-Lapierre (mathieu-tl) |
| importance: | Undecided → Medium |
| Jeremy Kerr (jk-ozlabs) wrote : | #2 |
Is it possible to do the same for trusty too?
That was the plan, I just had not reached that yet :)
| Jeremy Kerr (jk-ozlabs) wrote : | #4 |
@mathieu-tl: ok, super. Sorry, I didn't mean to be badgering you there, just wanted to make sure it's tracked somewhere! :)
Hello Jeremy, or anyone else affected,
Accepted ipmitool into trusty-proposed. The package will build now and be available at https:/
Please help us by testing this new package. See https:/
If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-
Further information regarding the verification process can be found at https:/
| Changed in ipmitool (Ubuntu Trusty): | |
| status: | New → Fix Committed |
| tags: | added: verification-needed |
| Changed in ipmitool (Ubuntu Trusty): | |
| importance: | Undecided → Medium |
| Changed in ipmitool (Ubuntu Vivid): | |
| importance: | Undecided → Medium |
| Changed in ipmitool (Ubuntu Wily): | |
| importance: | Undecided → Medium |
| Pavaman Subramaniyam (pavsubra) wrote : | #6 |
I have installed the ipmitool_
root@ltchabaner
--2015-11-16 03:10:11-- https:/
Resolving launchpad.net (launchpad.net)... 91.189.89.222, 91.189.89.223
Connecting to launchpad.net (launchpad.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https:/
--2015-11-16 03:10:12-- https:/
Resolving launchpadlibrar
Connecting to launchpadlibrar
HTTP request sent, awaiting response... 200 OK
Length: 311704 (304K) [application/
Saving to: âipmitool_
100%[==
2015-11-16 03:10:13 (601 KB/s) - âipmitool_
root@ltchabaner
Linux ltchabanero002 3.19.0-33-generic #38~14.04.1-Ubuntu SMP Fri Nov 6 18:17:15 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux
root@ltchabaner
NAME="Ubuntu"
VERSION="14.04.3 LTS, Trusty Tahr"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 14.04.3 LTS"
VERSION_ID="14.04"
HOME_URL="http://
SUPPORT_URL="http://
BUG_REPORT_URL="http://
root@ltchabaner
processor : 79
cpu : POWER8 (raw), altivec supported
clock : 3491.000000MHz
revision : 2.0 (pvr 004d 0200)
timebase : 512000000
platform : PowerNV
model : TN71-BP012
machine : PowerNV TN71-BP012
firmware : OPAL v3
root@ltchabaner
(Reading database ... 139136 files and directories currently installed.)
Preparing to unpack ipmitool_
Unpacking ipmitool (1.8.13-1ubuntu0.6) over (1.8.13-1ubuntu0.5) ...
Setting up ipmitool (1.8.13-1ubuntu0.6) ...
Processing triggers for man-db (2.6.7.1-1ubuntu1) ...
Processing triggers for ureadahead (0.100.0-16) ...
ureadahead will be reprofiled on next reboot
root@ltchabaner
/usr/bin/ipmitool
root@ltchabaner
ipmitool: /usr/bin/ipmitool
root@ltchabaner
ii ipmitool 1.8.13-1ubuntu0.6 ppc64el utility for IPMI control with kernel driver or LAN interface
root@ltchabaner
| Pavaman Subramaniyam (pavsubra) wrote : | #7 |
But when I follow the same steps on updating the OPAL 810 Firmware on Firestone Hardware, I am getting error as shown.
root@ltc-fire8:~# uname -a
Linux ltc-fire8 3.19.0-32-generic #37~14.04.1-Ubuntu SMP Thu Oct 22 10:11:54 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux
root@ltc-fire8:~# cat /etc/os-release
NAME="Ubuntu"
VERSION="14.04.3 LTS, Trusty Tahr"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 14.04.3 LTS"
VERSION_ID="14.04"
HOME_URL="http://
SUPPORT_URL="http://
BUG_REPORT_URL="http://
root@ltc-fire8:~# cat /proc/cpuinfo | tail
processor : 191
cpu : POWER8 (raw), altivec supported
clock : 2094.000000MHz
revision : 2.0 (pvr 004d 0200)
timebase : 512000000
platform : PowerNV
model : 8335-GTA
machine : PowerNV 8335-GTA
firmware : OPAL v3
root@ltc-fire8:~# wget https:/
--2015-11-16 02:16:02-- https:/
Resolving launchpad.net (launchpad.net)... 91.189.89.222, 91.189.89.223
Connecting to launchpad.net (launchpad.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https:/
--2015-11-16 02:16:03-- https:/
Resolving launchpadlibrar
Connecting to launchpadlibrar
HTTP request sent, awaiting response... 200 OK
Length: 311704 (304K) [application/
Saving to: âipmitool_
100%[==
2015-11-16 02:16:05 (316 KB/s) - âipmitool_
root@ltc-fire8:~# dpkg -i ipmitool_
(Reading database ... 123258 files and directories currently installed.)
Preparing to unpack ipmitool_
Unpacking ipmitool (1.8.13-1ubuntu0.6) over (1.8.13-1ubuntu0.5) ...
Setting up ipmitool (1.8.13-1ubuntu0.6) ...
Processing triggers for man-db (2.6.7.1-1ubuntu1) ...
Processing triggers for ureadahead (0.100.0-16) ...
ureadahead will be reprofiled on next reboot
root@ltc-fire8:~# which ipmitool
/usr/bin/ipmitool
root@ltc-fire8:~# dpkg -S /usr/bin/ipmitool
ipmitool: /usr/bin/ipmitool
root@ltc-fire8:~# dpkg --list | grep ipmitool
ii ipmitool 1.8.13-1ubuntu0.6 ppc64el utility for IPMI control with kernel driver or LAN interface
root@ltc-fire8:~# ipmitool -I usb lan print
Set in Progress : Set Complete
Auth Type Support : MD5
Auth Type Enable : Callback : MD5
...
| Jeremy Kerr (jk-ozlabs) wrote : | #8 |
Pavaman - thanks for verifying. The latter issue sounds like a BMC problem, which we're following-up separately.
| tags: |
added: verification-done removed: verification-needed |
| Launchpad Janitor (janitor) wrote : | #9 |
This bug was fixed in the package ipmitool - 1.8.13-1ubuntu0.6
---------------
ipmitool (1.8.13-1ubuntu0.6) trusty; urgency=medium
* debian/
16 devices on the SCSI bus when probing. Fixes the probing failing the
use of the USB transport for IPMI when there are more than 8 SCSI devices
on the bus, and follows the max devices for SCSI-3. (LP: #1509896)
-- Mathieu Trudel-Lapierre <email address hidden> Wed, 04 Nov 2015 17:36:22 -0600
| Changed in ipmitool (Ubuntu Trusty): | |
| status: | Fix Committed → Fix Released |
| Chris J Arges (arges) wrote : Update Released | #10 |
The verification of the Stable Release Update for ipmitool has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.
| description: | updated |
| Changed in ipmitool (Ubuntu Vivid): | |
| status: | New → In Progress |
| Changed in ipmitool (Ubuntu Wily): | |
| status: | New → In Progress |
| Changed in ipmitool (Ubuntu Vivid): | |
| assignee: | nobody → Mathieu Trudel-Lapierre (mathieu-tl) |
| Changed in ipmitool (Ubuntu Wily): | |
| assignee: | nobody → Mathieu Trudel-Lapierre (mathieu-tl) |
| Changed in ipmitool (Ubuntu Trusty): | |
| assignee: | nobody → Mathieu Trudel-Lapierre (mathieu-tl) |
| tags: | removed: verification-done |
Hello Jeremy, or anyone else affected,
Accepted ipmitool into wily-proposed. The package will build now and be available at https:/
Please help us by testing this new package. See https:/
If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-
Further information regarding the verification process can be found at https:/
| Changed in ipmitool (Ubuntu Wily): | |
| status: | In Progress → Fix Committed |
| tags: | added: verification-needed |
| Changed in ipmitool (Ubuntu Vivid): | |
| status: | In Progress → Fix Committed |
| Brian Murray (brian-murray) wrote : | #12 |
Hello Jeremy, or anyone else affected,
Accepted ipmitool into vivid-proposed. The package will build now and be available at https:/
Please help us by testing this new package. See https:/
If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-
Further information regarding the verification process can be found at https:/
| Frédéric Bonnard (frediz) wrote : | #13 |
Verification successfully done on Trusty with : ipmitool 1.8.13-1ubuntu0.6
According to the bug fix in git :
----
The current USB plugin doesn't find my IPMI channel:
# ipmitool -I usb mc info
Error in USB session setup
Unable to setup interface usb
Error loading interface usb
This is beacuse I have more than 8 scsi-generic devices that identify
as AMI:
# grep -c ^AMI /proc/scsi/
13
----
On my machine :
root@abana:~# dpkg -l|grep ipmitool
ii ipmitool 1.8.13-1ubuntu0.6 ppc64el utility for IPMI control with kernel driver or LAN interface
root@abana:~# grep -c ^AMI /proc/scsi/
13
root@abana:~# ipmitool -I usb mc info
Device ID : 32
Device Revision : 1
Firmware Revision : 2.06
IPMI Version : 2.0
Manufacturer ID : 0
Manufacturer Name : Unknown
Product ID : 43707 (0xaabb)
Product Name : Unknown (0xAABB)
Device Available : yes
Provides Device SDRs : no
Additional Device Support :
Sensor Device
SDR Repository Device
SEL Device
FRU Inventory Device
IPMB Event Receiver
IPMB Event Generator
Chassis Device
Aux Firmware Rev Info :
0xca
0x48
0x01
0x00
root@abana:~# ipmitool -I usb lan print
Set in Progress : Set Complete
Auth Type Support : MD5
Auth Type Enable : Callback : MD5
IP Address Source : DHCP Address
IP Address : 9.101.18.66
Subnet Mask : 255.255.255.0
MAC Address : a0:42:3f:27:34:b8
SNMP Community String : AMI
IP Header : TTL=0x40 Flags=0x40 Precedence=0x00 TOS=0x10
BMC ARP Control : ARP Responses Enabled, Gratuitous ARP Disabled
Gratituous ARP Intrvl : 0.0 seconds
Default Gateway IP : 9.101.18.254
Default Gateway MAC : 00:12:79:04:36:80
Backup Gateway IP : 0.0.0.0
Backup Gateway MAC : 00:00:00:00:00:00
802.1q VLAN ID : Disabled
802.1q VLAN Priority : 0
RMCP+ Cipher Suites : 0,1,2,3,
Cipher Suite Priv Max : caaaaaaaaaaaXXX
Bad Password Threshold : 0
Invalid password disable: no
Attempt Count Reset Int.: 0
User Lockout Interval : 0
| tags: |
added: verification-done removed: verification-needed |
Hi Frédéric;
Trusty has already been verified and landed. Did you mean vivid?
| tags: |
added: verification-needed removed: verification-done |
Hi @Jeremy, your patch was partially upstreamed, but since the important bits were, I deleted it.
I submitted a patch for the useless fp!=NULL check there
https:/
(one is correctly removed, this one isn't important because outside of the loop)
cheers,
G.
The version of ipmitool in the proposed pocket of Vivid that was purported to fix this bug report has been removed because the bugs that were to be fixed by the upload were not verified in a timely (105 days) fashion.
| Changed in ipmitool (Ubuntu Vivid): | |
| status: | Fix Committed → Won't Fix |
| Martin Pitt (pitti) wrote : | #20 |
The version of ipmitool in the proposed pocket of Wily that was purported to fix this bug report has been removed because the bugs that were to be fixed by the upload were not verified in a timely (105 days) fashion.
| Changed in ipmitool (Ubuntu Wily): | |
| status: | Fix Committed → Won't Fix |
| tags: | removed: verification-needed |
This bug was fixed in the package ipmitool - 1.8.15-1ubuntu2
---------------
ipmitool (1.8.15-1ubuntu2) xenial; urgency=medium
* debian/
fix probing for SCSI devices in the USB plugin. (LP: #1509896)
-- Mathieu Trudel-Lapierre <email address hidden> Wed, 28 Oct 2015 09:59:09 -0400