iLab: power kvm client after svc node reboot error inject test, multipath output show missing path and missing storage name

Bug #1503305 reported by bugproxy
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
multipath-tools (Ubuntu)
Fix Released
Medium
Mathieu Trudel-Lapierre
Trusty
Fix Released
Medium
Mathieu Trudel-Lapierre
Vivid
Won't Fix
Medium
Unassigned
Wily
Fix Released
Medium
Unassigned

Bug Description

[Impact]
Users of multipath will see incomplete output for the vendor and model values for devices where the first path is the path that is failed.

[Test Cases]
1) Experience a failed path:
echo 1 > /sys/devices/<path to device>/delete
(the above is an example for forcibly removing a path for SCSI via the /sys filesystem)
2) run: sudo multipath -ll
3) Verify the output, see below.

Storage name (vendor and model usually) should always be displayed after dm-* on the header line for a multipath device.

[Regression Potential]
This is limited to output and is thus purely a cosmetic fix. Possible issues leading from that fix would include crashes due to an incorrect patch or the output for vendor/model info for the device to still be incorrect.

----
== Comment: #0 - Yueh Chyong Jackson <email address hidden> - 2015-01-27 16:54:58 ==
---Problem Description---
power kvm client ubuntu ilp1fc85apA4 after error injection test (SVC node reboot), the multipath output show one path with #:#:#:# and did not show the storage name:
mpath6 (3600507680284066f1800000000000172) dm-6 , <---------(missing storage name)
size=3.0G features='1 queue_if_no_path' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=50 status=active
| |- #:#:#:# - #:# failed faulty running <----------------------------------------
| `- 4:0:7:0 sdbr 68:80 active ready running
`-+- policy='round-robin 0' prio=10 status=enabled
  |- 4:0:9:0 sdbq 68:64 active ready running
  `- 3:0:7:0 sdby 68:192 active ready running

this is a storage IBM svc storage

---uname output---
power kvm server: [root@ilp1fc85a ~]# uname -a Linux ilp1fc85a.tuc.stglabs.ibm.com 3.10.42-2018.1.pkvm2_1_1.46.ppc64 #1 SMP Fri Oct 17 10:41:35 CDT 2014 ppc64 ppc64 ppc64 GNU/Linux,
client uname : root@ilp1fc85apA4:~# uname -a Linux ilp1fc85apA4.tuc.stglabs.ibm.com 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:09:21 UTC 2014 ppc64le ppc64le ppc64le GNU/Linux

---Additional Hardware Info---
4 adapters, coho, bluefin, houston,houston FCoE, with following storages:
DS8800,TMS, xiv gen2, svc V7k ,texan, texan FCoE, client lun that use for running tests(data lun) are passthrough

access to machines:
power kvm server: ilp1fc85a 9.11.56.126 (ssh root/B!gm0ney)
client: ilp1fc85apA4 9.11.56.72 (ssh root/B!gmoney)

the logs are save at:
ip: 9.11.56.167(root/teamw0rk), under file:
/root/bflocal/CYCLE18/CheckHostStatus_V2/CYCLE18_226/scripts/9.11.56.72.hostcheck.CHS.svc_nr.stop.20150127073959

ip: 9.11.56.168 (root/teamw0rk), under file:
/PACKAGE/errlogs/Cycle18/SVC_NR/20150127081651/
c_85_g.ilp1fc85apA4.SVC_NR.Cycle18.27Jan15.081758.tar.gz

Machine Type = IBM Power System S824, product: 8286-42A,serial: 10CD74T

---Debugger---
A debugger is not configured

Contact Information = ida <email address hidden>, <email address hidden>

Stack trace output:
 no

Oops output:
 no

System Dump Info:
  The system is not configured to capture a system dump.

*Additional Instructions for ida <email address hidden>, <email address hidden>:
-Post a private note with access information to the mach
ine that the bug is occuring on.
-Attach sysctl -a output output to the bug.

please let me know if other info is needed. thanks for looking into the problem

== Comment: #9 - Vaishnavi Bhat <email address hidden> - 2015-02-11 04:11:40 ==

== Comment: #17 - Andrea M. Davis <email address hidden> - 2015-03-03 17:57:51 ==
Please update the bug with the specific Ubunutu release please Ida or Chang.

== Comment: #18 - Andrea M. Davis <email address hidden> - 2015-03-03 17:57:56 ==
Please update the bug with the specific Ubunutu release please Ida or Chang.

== Comment: #19 - Mauricio Faria De Oliveira <email address hidden> - 2015-03-04 08:17:23 ==
This is Ubuntu 14.04 GA (14.04.0), using the ISO/DVD install (kernel 3.13.0-24).

> client uname : root@ilp1fc85apA4:~# uname -a Linux ilp1fc85apA4.tuc.stglabs.ibm.com 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:09:21 UTC 2014 ppc64le ppc64le ppc64le GNU/Linux

This version is way old (2014/04) for a bug reported on 2015/1, in Ubuntu's fast pace.

Do the guest has any* other updates applied? (i.e., apt-get update && apt-get upgrade)
It seems there are no kernel upgrades as well?(i.e., apt-get update && apt-get dist-upgrade)

Any reason for not testing 14.04.1 or 14.04.2? (you can bump to it w/ dist-upgrade)

== Comment: #20 - Brian J. King <email address hidden> - 2015-03-04 10:11:57 ==
(In reply to comment #19)
> This is Ubuntu 14.04 GA (14.04.0), using the ISO/DVD install (kernel
> 3.13.0-24).

Also keep in mind that you need at *least* 14.04.1 in order to be able to do PCI passthrough with PowerKVM.

== Comment: #29 - Gabriel Krisman Bertazi <email address hidden> - 2015-09-30 15:38:23 ==
The attached patch should fix this issue. Mauricio, please tell me what you think.

== Comment: #30 - Mauricio Faria De Oliveira <email address hidden> - 2015-10-02 09:52:01 ==
Gabriel,

Looks good to me.
Good discussion yesterday while traveling.

Let's hear on dm-devel.

Thanks!

== Comment: #32 - Gabriel Krisman Bertazi <email address hidden> - 2015-10-06 08:28:24 ==
Patch is applied to Christophe's tree. <https://www.redhat.com/archives/dm-devel/2015-October/msg00021.html>.

Now, let's get it downstream into Ubuntu.

== Comment: #34 - Gabriel Krisman Bertazi <email address hidden> - 2015-10-06 08:55:40 ==
Christophe Varoqui applied this patch to his multipath-tools tree <https://www.redhat.com/archives/dm-devel/2015-October/msg00022.html>.

We would like it to be backported to Ubuntu to close this bug.

Revision history for this message
bugproxy (bugproxy) wrote : syslog file

Default Comment by Bridge

tags: added: architecture-ppc64le bugnameltc-120998 severity-medium targetmilestone-inin14043
Revision history for this message
bugproxy (bugproxy) wrote : dmesg file

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp1fc85apA4 syslog

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp2fc82ap61 messages log

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : 'multipath -v 3' from client ilp1fc85apA4

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : fix information not shown when first path is down

Default Comment by Bridge

Gary Gaydos (gmgaydos)
affects: ubuntu → multipath-tools (Ubuntu)
Revision history for this message
bugproxy (bugproxy) wrote : Comment bridged from LTC Bugzilla

------- Comment From <email address hidden> 2015-10-29 13:36 EDT-------
Any updates on this from Ubuntu team?

Changed in multipath-tools (Ubuntu):
assignee: nobody → Taco Screen team (taco-screen-team)
Revision history for this message
Steve Langasek (vorlon) wrote :

This looks like a straightforward patch to backport and apply; confirming from our side.

Changed in multipath-tools (Ubuntu):
assignee: Taco Screen team (taco-screen-team) → Mathieu Trudel-Lapierre (mathieu-tl)
importance: Undecided → Medium
status: New → Triaged
Revision history for this message
Mathieu Trudel-Lapierre (cyphermox) wrote :

In Progress.

Changed in multipath-tools (Ubuntu):
status: Triaged → In Progress
Revision history for this message
Mathieu Trudel-Lapierre (cyphermox) wrote :

I'm ready to apply the patch, but doing this on 14.04 right now would likely mean further delays for another stable update in progress. I'd rather wait until that update is done and fully verified (waiting for a confirmation from mauricfo) before adding a new patch to go through the SRU process.

I can however apply this now to the devel release and to 15.04 and 15.10.

Changed in multipath-tools (Ubuntu Trusty):
status: New → In Progress
Changed in multipath-tools (Ubuntu Vivid):
status: New → In Progress
Changed in multipath-tools (Ubuntu Wily):
status: New → In Progress
Changed in multipath-tools (Ubuntu Trusty):
importance: Undecided → Medium
Changed in multipath-tools (Ubuntu Vivid):
importance: Undecided → Medium
Changed in multipath-tools (Ubuntu Wily):
importance: Undecided → Medium
description: updated
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package multipath-tools - 0.5.0-7ubuntu9

---------------
multipath-tools (0.5.0-7ubuntu9) xenial; urgency=medium

  * d/p/lp1503305_libmultipath_info_on_1st_path_down_dbd131e.patch:
    Correctly display the vendor/model info on path line in output if the
    first path of a path group is failed. (LP: #1503305)

 -- Mathieu Trudel-Lapierre <email address hidden> Tue, 03 Nov 2015 18:34:09 -0600

Changed in multipath-tools (Ubuntu):
status: In Progress → Fix Released
Revision history for this message
Chris J Arges (arges) wrote : Please test proposed package

Hello bugproxy, or anyone else affected,

Accepted multipath-tools into wily-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/multipath-tools/0.5.0-7ubuntu7.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in multipath-tools (Ubuntu Wily):
status: In Progress → Fix Committed
tags: added: verification-needed
Revision history for this message
bugproxy (bugproxy) wrote : Comment bridged from LTC Bugzilla

------- Comment From <email address hidden> 2015-11-05 18:20 EDT-------
Tested package from Willy-Proposed. Bug seems to be fixed there. Thanks.

Revision history for this message
Breno Leitão (breno-leitao) wrote :

Changing the tags to verification-done according to IBM internal tests.

tags: added: verification-done
removed: verification-needed
Revision history for this message
bugproxy (bugproxy) wrote : 'multipath -v 3' from client ilp1fc85apA4

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : fix information not shown when first path is down

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote :

------- Comment (attachment only) From <email address hidden> 2015-10-06 17:57 EDT-------

Revision history for this message
bugproxy (bugproxy) wrote : 'multipath -v 3' from client ilp1fc85apA4

------- Comment (attachment only) From <email address hidden> 2015-10-06 17:59 EDT-------

Steve Langasek (vorlon)
Changed in multipath-tools (Ubuntu Trusty):
assignee: nobody → Mathieu Trudel-Lapierre (mathieu-tl)
milestone: none → ubuntu-14.04.4
Revision history for this message
bugproxy (bugproxy) wrote : dmesg file

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote :

------- Comment (attachment only) From <email address hidden> 2015-10-06 18:03 EDT-------

Revision history for this message
Mathieu Trudel-Lapierre (cyphermox) wrote :

For 14.04 this is waiting for the current update pending verification to be completed. If you can help in verifying bug https://bugs.launchpad.net/ubuntu/+source/multipath-tools/+bug/1386637, that could speed up providing all updates.

Revision history for this message
bugproxy (bugproxy) wrote :

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp1fc85apA4 syslog

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp2fc82ap61 messages log

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : 'multipath -v 3' from client ilp1fc85apA4

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : fix information not shown when first path is down

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote :

------- Comment (attachment only) From <email address hidden> 2015-10-06 17:57 EDT-------

Revision history for this message
bugproxy (bugproxy) wrote : 'multipath -v 3' from client ilp1fc85apA4

------- Comment (attachment only) From <email address hidden> 2015-10-06 17:59 EDT-------

Revision history for this message
bugproxy (bugproxy) wrote : ilp2fc82ap61 messages log

------- Comment (attachment only) From <email address hidden> 2015-10-06 18:00 EDT-------

Revision history for this message
bugproxy (bugproxy) wrote : ilp1fc85apA4 syslog

------- Comment (attachment only) From <email address hidden> 2015-10-06 18:01 EDT-------

Revision history for this message
bugproxy (bugproxy) wrote : dmesg file

------- Comment (attachment only) From <email address hidden> 2015-10-06 18:03 EDT-------

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package multipath-tools - 0.5.0-7ubuntu7.1

---------------
multipath-tools (0.5.0-7ubuntu7.1) wily; urgency=medium

  * debian/patches/lp1503305_libmultipath_info_on_1st_path_down_dbd131e.patch:
    Correctly display vendor/model info for a path group even if the first path
    of the group is failed. (LP: #1503305)

 -- Mathieu Trudel-Lapierre <email address hidden> Wed, 04 Nov 2015 10:40:53 -0600

Changed in multipath-tools (Ubuntu Wily):
status: Fix Committed → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Update Released

The verification of the Stable Release Update for multipath-tools has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

bugproxy (bugproxy)
tags: removed: bugnameltc-120998 severity-medium verification-done
Revision history for this message
Chris J Arges (arges) wrote : Please test proposed package

Hello bugproxy, or anyone else affected,

Accepted multipath-tools into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/multipath-tools/0.4.9-3ubuntu7.7 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in multipath-tools (Ubuntu Trusty):
status: In Progress → Fix Committed
tags: added: verification-needed
tags: added: verification-done
removed: verification-needed
bugproxy (bugproxy)
tags: added: bugnameltc-120998 severity-medium
removed: verification-done
Steve Langasek (vorlon)
tags: added: verification-done
Revision history for this message
bugproxy (bugproxy) wrote : syslog file

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : dmesg file

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp1fc85apA4 syslog

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp2fc82ap61 messages log

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : fix information not shown when first path is down

Default Comment by Bridge

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package multipath-tools - 0.4.9-3ubuntu7.7

---------------
multipath-tools (0.4.9-3ubuntu7.7) trusty; urgency=medium

  * debian/patches/lp1503305_libmultipath_info_on_1st_path_down_dbd131e.patch:
    Correctly display vendor/model info for a path group even if the first path
    of the group is failed. (LP: #1503305)

 -- Mathieu Trudel-Lapierre <email address hidden> Tue, 15 Dec 2015 13:52:49 -0500

Changed in multipath-tools (Ubuntu Trusty):
status: Fix Committed → Fix Released
Revision history for this message
bugproxy (bugproxy) wrote : syslog file

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : dmesg file

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp1fc85apA4 syslog

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : ilp2fc82ap61 messages log

Default Comment by Bridge

Revision history for this message
bugproxy (bugproxy) wrote : fix information not shown when first path is down

Default Comment by Bridge

Revision history for this message
Mathieu Trudel-Lapierre (cyphermox) wrote :

Vivid is EOL, setting to Won't Fix.

Changed in multipath-tools (Ubuntu Vivid):
status: In Progress → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.