Activity log for bug #1987387

Date Who What changed Old value New value Message
2022-08-23 10:39:18 bugproxy bug added bug
2022-08-23 10:39:20 bugproxy tags architecture-s39064 bugnameltc-199411 severity-medium targetmilestone-inin---
2022-08-23 10:39:22 bugproxy ubuntu: assignee Skipper Bug Screeners (skipper-screen-team)
2022-08-23 10:39:26 bugproxy affects ubuntu linux (Ubuntu)
2022-08-24 14:11:55 Frank Heimes affects linux (Ubuntu) s390-tools (Ubuntu)
2022-08-24 14:12:03 Frank Heimes bug task added ubuntu-z-systems
2022-08-24 14:12:22 Frank Heimes ubuntu-z-systems: assignee Skipper Bug Screeners (skipper-screen-team)
2022-08-24 14:12:24 Frank Heimes s390-tools (Ubuntu): importance Undecided Medium
2022-08-24 14:12:27 Frank Heimes ubuntu-z-systems: importance Undecided Medium
2022-08-25 21:49:26 bugproxy tags architecture-s39064 bugnameltc-199411 severity-medium targetmilestone-inin--- architecture-s39064 bugnameltc-199411 severity-medium targetmilestone-inin2004
2022-08-28 17:49:22 Frank Heimes description == Comment: #0 - Thorsten Diehl <thorsten.diehl@de.ibm.com> - 2022-08-16 12:40:46 == I installed Ubuntu 20.04.4 LTS on IBM z14, enabled two DASDs, created one partition on each DASD and created an mvdump.conf file like this: /dev/dasdc1 /dev/dasdd1 I wrote the boot record by zipl -n -M mvdump.conf and IPLed the system from dasdc devno. The dump completed succesfully. Then I tried to get this dump via zgetdump on the restarted Ubuntu 20.04.4 system (zgetdump -v reports version 2.12.0-build-20220506), I got the following error: root@m8330032:~# zgetdump -i /dev/dasdc zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdc1 zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd1 zgetdump: No valid dump found on "/dev/dasdd1" root@m8330032:~# However, If I'm doing the same zgetdump on another system (e.g. with newer s390-tools version), I get the expected result m83lp32:~ # zgetdump -i /dev/dasdc General dump info: Dump format........: s390mv_ext Version............: 1 Dump created.......: Tue, 16 Aug 2022 18:31:57 +0200 Dump ended.........: Tue, 16 Aug 2022 18:32:02 +0200 Dump CPU ID........: ff1fa1e739068000 UTS node name......: m8330032.lnxne.boe UTS kernel release.: 5.4.0-124-generic UTS kernel version.: #140-Ubuntu SMP Thu Aug 4 02:23:07 UTC 2022 Build arch.........: s390x (64 bit) System arch........: s390x (64 bit) CPU count (online).: 16 CPU count (real)...: 16 Dump memory range..: 4096 MB Real memory range..: 4096 MB Dump file size.....: 849 MB Memory map: 0000000000000000 - 00000000ffffffff (4096 MB) Dump device info: Volume 0: 0.0.9405 (online/active) Volume 1: 0.0.9406 (online/valid) m83lp32:~ # The error is easily reproducible. Please update zgetdump to a newer version to solve this RAS problem. With Jammy (22.04.1; s390-tools version 2.20.0-build-20220623) this problem does not occur. == Comment: #3 - Jan Hoeppner <Jan.Hoeppner@de.ibm.com> - 2022-08-22 01:43:45 == There were several issues fixed in s390-tools v2.15.1 in regards to multivolume dumps: https://github.com/ibm-s390-linux/s390-tools/releases/tag/v2.15.1 Especially the following upstream commit for zgetdump: https://github.com/ibm-s390-linux/s390-tools/commit/d55b787d05eb9bd70f93c36cf859b66b2ad02038 SRU Justification: ================== [Impact] * The zgetdump tool (as part of the current s390-tools version in focal) is not able to handle multi-volume dumps (DASD disk) dumps. * While this is rarely needed, it is extremely annoying if one is in usually urgent need to use it and it does not work. * On s390x systems multi-volume (DASD disk) dumps are pretty common, due to usually costly and therefore limited disk resources, DASD disks are usually relatively small. [Fix] * d55b787 d55b787d05eb9bd70f93c36cf859b66b2ad02038 "zgetdump: Fix device node determination via sysfs" [Test Plan] * Have an IBM zSystems LPAR with Ubuntu 20.04 / focal (latest). * Have two (or more) additional DASD disks reserved for storing dumps, assigned to the system and enabled: sudo chzdev -e 0002, 0003 (Assuming 0001 has Ubuntu 20.04 installed - all 3390 disks). Get the block device names using 'lsdasd' - assuming here dasdb, dasdc * If needed low-level format these disks: sudo dasdfmt -y -b 4096 /dev/dasdb sudo dasdfmt -y -b 4096 /dev/dasdc * Create one single partition per disk: fdisk -a /dev/dasdb fdisk -a /dev/dasdc * Create an mvdump.conf file that points to the above disks sudo vi /etc/mvdump.conf ... cat /etc/mvdump.conf /dev/dasdb1 /dev/dasdc1 * Re-write the zipl boot record like this: sudo zipl -n -M /etc/mvdump.conf * Now ipl the system from the first dump DASD: 0002 and initiate the DASD dump by: 1. Stop all CPUs. 2. Store status on the IPL CPU. 3. IPL the dump tool on the IPL CPU. * Wait until the dump is completed and re-ipl the Ubuntu 20.04 again (0001). * Without this fix one will see a message like this: zgetdump -i /dev/dasdb zgetdump: Could not open "/sys/bus/ccw/devices/0.0.0002/dasdb/dev" (No such file or directory) * With the fix one will see a message like this: zgetdump -i /dev/dasdb General dump info: Dump format........: s390mv_ext Version............: 1 Dump created.......: ... Dump device info: Volume 0: 0.0.0002 (online/active) Volume 1: 0.0.0003 (online/valid) * For more in-depth details see the 'Linux on System z. Using the Dump Tools.' documentation: https://www.ibm.com/docs/en/linux-on-systems?topic=dump-hmc-se-example [Where problems could occur] * A new function got introduced to 'check whether a device with a given busid is online'. Issues could occur in case this function is broken and checks for a wrong busid, has a wrong path or handled the status wrongly. * The kind of 'little' refactoring of that patch may lead to further unexpected issues (that can largely identified by a test build). * The additional use of libutil functions may cause issues in case of an outdated libutil that does not offer all needed functions. (Testable with a test build.) * Erroneous code may even break single volume dumps [Other Info] * This code is known to work with hirsute and newer Ubuntu releases, esp. jammy (respectively their s390-tools versions). * The upstream code can be cleanly cherry-picked, hence is applied as-is. * An updated s390-tools version 2.12.0-0ubuntu3.7 with a patched zgetdump tool was build and made available via this PPA: https://launchpad.net/~fheimes/+archive/ubuntu/lp1987387 and was already successfully tested! __________ == Comment: #0 - Thorsten Diehl <thorsten.diehl@de.ibm.com> - 2022-08-16 12:40:46 == I installed Ubuntu 20.04.4 LTS on IBM z14, enabled two DASDs, created one partition on each DASD and created an mvdump.conf file like this: /dev/dasdc1 /dev/dasdd1 I wrote the boot record by zipl -n -M mvdump.conf and IPLed the system from dasdc devno. The dump completed succesfully. Then I tried to get this dump via zgetdump on the restarted Ubuntu 20.04.4 system (zgetdump -v reports version 2.12.0-build-20220506), I got the following error: root@m8330032:~# zgetdump -i /dev/dasdc zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdc1 zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd1 zgetdump: No valid dump found on "/dev/dasdd1" root@m8330032:~# However, If I'm doing the same zgetdump on another system (e.g. with newer s390-tools version), I get the expected result m83lp32:~ # zgetdump -i /dev/dasdc General dump info:   Dump format........: s390mv_ext   Version............: 1   Dump created.......: Tue, 16 Aug 2022 18:31:57 +0200   Dump ended.........: Tue, 16 Aug 2022 18:32:02 +0200   Dump CPU ID........: ff1fa1e739068000   UTS node name......: m8330032.lnxne.boe   UTS kernel release.: 5.4.0-124-generic   UTS kernel version.: #140-Ubuntu SMP Thu Aug 4 02:23:07 UTC 2022   Build arch.........: s390x (64 bit)   System arch........: s390x (64 bit)   CPU count (online).: 16   CPU count (real)...: 16   Dump memory range..: 4096 MB   Real memory range..: 4096 MB   Dump file size.....: 849 MB Memory map:   0000000000000000 - 00000000ffffffff (4096 MB) Dump device info:   Volume 0: 0.0.9405 (online/active)   Volume 1: 0.0.9406 (online/valid) m83lp32:~ # The error is easily reproducible. Please update zgetdump to a newer version to solve this RAS problem. With Jammy (22.04.1; s390-tools version 2.20.0-build-20220623) this problem does not occur. == Comment: #3 - Jan Hoeppner <Jan.Hoeppner@de.ibm.com> - 2022-08-22 01:43:45 == There were several issues fixed in s390-tools v2.15.1 in regards to multivolume dumps: https://github.com/ibm-s390-linux/s390-tools/releases/tag/v2.15.1 Especially the following upstream commit for zgetdump: https://github.com/ibm-s390-linux/s390-tools/commit/d55b787d05eb9bd70f93c36cf859b66b2ad02038
2022-08-28 17:49:28 Frank Heimes s390-tools (Ubuntu): status New In Progress
2022-08-28 17:49:31 Frank Heimes ubuntu-z-systems: status New In Progress
2022-08-28 17:53:01 Frank Heimes attachment added debdiff_s390-tools_focal_from_2.12.0-0ubuntu3.6_to_2.12.0-0ubuntu3.7.diff https://bugs.launchpad.net/ubuntu/+source/s390-tools/+bug/1987387/+attachment/5612166/+files/debdiff_s390-tools_focal_from_2.12.0-0ubuntu3.6_to_2.12.0-0ubuntu3.7.diff
2022-08-28 17:53:18 Frank Heimes attachment added debdiff_s390-tools-signed_focal_from_2.12.0-0ubuntu3.6_to_2.12.0-0ubuntu3.7.diff https://bugs.launchpad.net/ubuntu/+source/s390-tools/+bug/1987387/+attachment/5612167/+files/debdiff_s390-tools-signed_focal_from_2.12.0-0ubuntu3.6_to_2.12.0-0ubuntu3.7.diff
2022-08-28 17:53:33 Frank Heimes s390-tools (Ubuntu): assignee Skipper Bug Screeners (skipper-screen-team)
2022-08-28 20:22:02 Ubuntu Foundations Team Bug Bot tags architecture-s39064 bugnameltc-199411 severity-medium targetmilestone-inin2004 architecture-s39064 bugnameltc-199411 patch severity-medium targetmilestone-inin2004
2022-08-28 20:22:12 Ubuntu Foundations Team Bug Bot bug added subscriber Ubuntu Sponsors Team
2022-09-29 14:45:56 Frank Heimes s390-tools (Ubuntu): importance Medium High
2022-09-29 14:46:36 Frank Heimes description SRU Justification: ================== [Impact] * The zgetdump tool (as part of the current s390-tools version in focal) is not able to handle multi-volume dumps (DASD disk) dumps. * While this is rarely needed, it is extremely annoying if one is in usually urgent need to use it and it does not work. * On s390x systems multi-volume (DASD disk) dumps are pretty common, due to usually costly and therefore limited disk resources, DASD disks are usually relatively small. [Fix] * d55b787 d55b787d05eb9bd70f93c36cf859b66b2ad02038 "zgetdump: Fix device node determination via sysfs" [Test Plan] * Have an IBM zSystems LPAR with Ubuntu 20.04 / focal (latest). * Have two (or more) additional DASD disks reserved for storing dumps, assigned to the system and enabled: sudo chzdev -e 0002, 0003 (Assuming 0001 has Ubuntu 20.04 installed - all 3390 disks). Get the block device names using 'lsdasd' - assuming here dasdb, dasdc * If needed low-level format these disks: sudo dasdfmt -y -b 4096 /dev/dasdb sudo dasdfmt -y -b 4096 /dev/dasdc * Create one single partition per disk: fdisk -a /dev/dasdb fdisk -a /dev/dasdc * Create an mvdump.conf file that points to the above disks sudo vi /etc/mvdump.conf ... cat /etc/mvdump.conf /dev/dasdb1 /dev/dasdc1 * Re-write the zipl boot record like this: sudo zipl -n -M /etc/mvdump.conf * Now ipl the system from the first dump DASD: 0002 and initiate the DASD dump by: 1. Stop all CPUs. 2. Store status on the IPL CPU. 3. IPL the dump tool on the IPL CPU. * Wait until the dump is completed and re-ipl the Ubuntu 20.04 again (0001). * Without this fix one will see a message like this: zgetdump -i /dev/dasdb zgetdump: Could not open "/sys/bus/ccw/devices/0.0.0002/dasdb/dev" (No such file or directory) * With the fix one will see a message like this: zgetdump -i /dev/dasdb General dump info: Dump format........: s390mv_ext Version............: 1 Dump created.......: ... Dump device info: Volume 0: 0.0.0002 (online/active) Volume 1: 0.0.0003 (online/valid) * For more in-depth details see the 'Linux on System z. Using the Dump Tools.' documentation: https://www.ibm.com/docs/en/linux-on-systems?topic=dump-hmc-se-example [Where problems could occur] * A new function got introduced to 'check whether a device with a given busid is online'. Issues could occur in case this function is broken and checks for a wrong busid, has a wrong path or handled the status wrongly. * The kind of 'little' refactoring of that patch may lead to further unexpected issues (that can largely identified by a test build). * The additional use of libutil functions may cause issues in case of an outdated libutil that does not offer all needed functions. (Testable with a test build.) * Erroneous code may even break single volume dumps [Other Info] * This code is known to work with hirsute and newer Ubuntu releases, esp. jammy (respectively their s390-tools versions). * The upstream code can be cleanly cherry-picked, hence is applied as-is. * An updated s390-tools version 2.12.0-0ubuntu3.7 with a patched zgetdump tool was build and made available via this PPA: https://launchpad.net/~fheimes/+archive/ubuntu/lp1987387 and was already successfully tested! __________ == Comment: #0 - Thorsten Diehl <thorsten.diehl@de.ibm.com> - 2022-08-16 12:40:46 == I installed Ubuntu 20.04.4 LTS on IBM z14, enabled two DASDs, created one partition on each DASD and created an mvdump.conf file like this: /dev/dasdc1 /dev/dasdd1 I wrote the boot record by zipl -n -M mvdump.conf and IPLed the system from dasdc devno. The dump completed succesfully. Then I tried to get this dump via zgetdump on the restarted Ubuntu 20.04.4 system (zgetdump -v reports version 2.12.0-build-20220506), I got the following error: root@m8330032:~# zgetdump -i /dev/dasdc zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdc1 zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd1 zgetdump: No valid dump found on "/dev/dasdd1" root@m8330032:~# However, If I'm doing the same zgetdump on another system (e.g. with newer s390-tools version), I get the expected result m83lp32:~ # zgetdump -i /dev/dasdc General dump info:   Dump format........: s390mv_ext   Version............: 1   Dump created.......: Tue, 16 Aug 2022 18:31:57 +0200   Dump ended.........: Tue, 16 Aug 2022 18:32:02 +0200   Dump CPU ID........: ff1fa1e739068000   UTS node name......: m8330032.lnxne.boe   UTS kernel release.: 5.4.0-124-generic   UTS kernel version.: #140-Ubuntu SMP Thu Aug 4 02:23:07 UTC 2022   Build arch.........: s390x (64 bit)   System arch........: s390x (64 bit)   CPU count (online).: 16   CPU count (real)...: 16   Dump memory range..: 4096 MB   Real memory range..: 4096 MB   Dump file size.....: 849 MB Memory map:   0000000000000000 - 00000000ffffffff (4096 MB) Dump device info:   Volume 0: 0.0.9405 (online/active)   Volume 1: 0.0.9406 (online/valid) m83lp32:~ # The error is easily reproducible. Please update zgetdump to a newer version to solve this RAS problem. With Jammy (22.04.1; s390-tools version 2.20.0-build-20220623) this problem does not occur. == Comment: #3 - Jan Hoeppner <Jan.Hoeppner@de.ibm.com> - 2022-08-22 01:43:45 == There were several issues fixed in s390-tools v2.15.1 in regards to multivolume dumps: https://github.com/ibm-s390-linux/s390-tools/releases/tag/v2.15.1 Especially the following upstream commit for zgetdump: https://github.com/ibm-s390-linux/s390-tools/commit/d55b787d05eb9bd70f93c36cf859b66b2ad02038 SRU Justification: ================== [Impact] * The zgetdump tool (as part of the current s390-tools version in focal) is not able to handle multi-volume dumps (DASD disk) dumps. * While this is rarely needed, it is extremely annoying if one is in usually urgent need to use it and it does not work. * On s390x systems multi-volume (DASD disk) dumps are pretty common, due to usually costly and therefore limited disk resources, DASD disks are usually relatively small. [Fix] * d55b787 d55b787d05eb9bd70f93c36cf859b66b2ad02038 "zgetdump: Fix device node determination via sysfs" [Test Plan] * Have an IBM zSystems LPAR with Ubuntu 20.04 / focal (latest). * Have two (or more) additional DASD disks reserved for storing dumps, assigned to the system and enabled: sudo chzdev -e 0002, 0003 (Assuming 0001 has Ubuntu 20.04 installed - all 3390 disks). Get the block device names using 'lsdasd' - assuming here dasdb, dasdc * If needed low-level format these disks: sudo dasdfmt -y -b 4096 /dev/dasdb sudo dasdfmt -y -b 4096 /dev/dasdc * Create one single partition per disk: fdisk -a /dev/dasdb fdisk -a /dev/dasdc * Create an mvdump.conf file that points to the above disks sudo vi /etc/mvdump.conf ... cat /etc/mvdump.conf /dev/dasdb1 /dev/dasdc1 * Re-write the zipl boot record like this: sudo zipl -n -M /etc/mvdump.conf * Now ipl the system from the first dump DASD: 0002 and initiate the DASD dump by: 1. Stop all CPUs. 2. Store status on the IPL CPU. 3. IPL the dump tool on the IPL CPU. * Wait until the dump is completed and re-ipl the Ubuntu 20.04 again (0001). * Without this fix one will see a message like this: zgetdump -i /dev/dasdb zgetdump: Could not open "/sys/bus/ccw/devices/0.0.0002/dasdb/dev" (No such file or directory) * With the fix one will see a message like this: zgetdump -i /dev/dasdb General dump info: Dump format........: s390mv_ext Version............: 1 Dump created.......: ... Dump device info: Volume 0: 0.0.0002 (online/active) Volume 1: 0.0.0003 (online/valid) * For more in-depth details see the 'Linux on System z. Using the Dump Tools.' documentation: https://www.ibm.com/docs/en/linux-on-systems?topic=dump-hmc-se-example [Where problems could occur] * A new function got introduced to 'check whether a device with a given busid is online'. Issues could occur in case this function is broken and checks for a wrong busid, has a wrong path or handled the status wrongly. * The kind of 'little' refactoring of that patch may lead to further unexpected issues (that can largely identified by a test build). * The additional use of libutil functions may cause issues in case of an outdated libutil that does not offer all needed functions. (Testable with a test build.) * Erroneous code may even break single volume dumps [Other Info] * This code is known to work with hirsute and newer Ubuntu releases, esp. jammy (respectively their s390-tools versions). * The upstream code can be cleanly cherry-picked, hence is applied as-is. * An updated s390-tools version 2.12.0-0ubuntu3.7 with a patched zgetdump tool was build and made available via this PPA: https://launchpad.net/~fheimes/+archive/ubuntu/lp1987387 and was already successfully tested! __________ == Comment: #0 - Thorsten Diehl <thorsten.diehl@de.ibm.com> - 2022-08-16 12:40:46 == I installed Ubuntu 20.04.4 LTS on IBM z14, enabled two DASDs, created one partition on each DASD and created an mvdump.conf file like this: /dev/dasdc1 /dev/dasdd1 I wrote the boot record by zipl -n -M mvdump.conf and IPLed the system from dasdc devno. The dump completed succesfully. Then I tried to get this dump via zgetdump on the restarted Ubuntu 20.04.4 system (zgetdump -v reports version 2.12.0-build-20220506), I got the following error: root@m8330032:~# zgetdump -i /dev/dasdc zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdc1 zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd1 zgetdump: No valid dump found on "/dev/dasdd1" root@m8330032:~# However, If I'm doing the same zgetdump on another system (e.g. with newer s390-tools version), I get the expected result m83lp32:~ # zgetdump -i /dev/dasdc General dump info:   Dump format........: s390mv_ext   Version............: 1   Dump created.......: Tue, 16 Aug 2022 18:31:57 +0200   Dump ended.........: Tue, 16 Aug 2022 18:32:02 +0200   Dump CPU ID........: ff1fa1e739068000   UTS node name......: m8330032.lnxne.boe   UTS kernel release.: 5.4.0-124-generic   UTS kernel version.: #140-Ubuntu SMP Thu Aug 4 02:23:07 UTC 2022   Build arch.........: s390x (64 bit)   System arch........: s390x (64 bit)   CPU count (online).: 16   CPU count (real)...: 16   Dump memory range..: 4096 MB   Real memory range..: 4096 MB   Dump file size.....: 849 MB Memory map:   0000000000000000 - 00000000ffffffff (4096 MB) Dump device info:   Volume 0: 0.0.9405 (online/active)   Volume 1: 0.0.9406 (online/valid) m83lp32:~ # The error is easily reproducible. Please update zgetdump to a newer version to solve this RAS problem. With Jammy (22.04.1; s390-tools version 2.20.0-build-20220623) this problem does not occur. == Comment: #3 - Jan Hoeppner <Jan.Hoeppner@de.ibm.com> - 2022-08-22 01:43:45 == There were several issues fixed in s390-tools v2.15.1 in regards to multivolume dumps: https://github.com/ibm-s390-linux/s390-tools/releases/tag/v2.15.1 Especially the following upstream commit for zgetdump: https://github.com/ibm-s390-linux/s390-tools/commit/d55b787d05eb9bd70f93c36cf859b66b2ad02038 --- External link: https://warthogs.atlassian.net/browse/PEI-30
2022-09-29 14:46:37 Frank Heimes tags architecture-s39064 bugnameltc-199411 patch severity-medium targetmilestone-inin2004 architecture-s39064 bugnameltc-199411 patch pei-30 severity-medium targetmilestone-inin2004
2022-10-11 13:24:19 Simon Chopin nominated for series Ubuntu Focal
2022-10-11 13:24:19 Simon Chopin bug task added s390-tools (Ubuntu Focal)
2022-10-11 13:24:26 Simon Chopin s390-tools (Ubuntu Focal): status New Triaged
2022-10-11 13:24:56 Simon Chopin s390-tools (Ubuntu): status In Progress Fix Released
2022-10-11 13:24:58 Simon Chopin s390-tools (Ubuntu Focal): importance Undecided High
2022-10-11 13:25:13 Simon Chopin bug task added s390-tools-signed (Ubuntu)
2022-10-11 13:25:20 Simon Chopin s390-tools-signed (Ubuntu Focal): status New Triaged
2022-10-11 13:25:23 Simon Chopin s390-tools-signed (Ubuntu): status New Fix Released
2022-10-11 13:25:27 Simon Chopin s390-tools-signed (Ubuntu Focal): importance Undecided High
2022-10-11 13:45:05 Frank Heimes ubuntu-z-systems: status In Progress Fix Released
2022-10-11 13:46:52 Frank Heimes ubuntu-z-systems: status Fix Released In Progress
2022-12-02 00:54:43 Łukasz Zemczak s390-tools (Ubuntu Focal): status Triaged Fix Committed
2022-12-02 00:54:45 Łukasz Zemczak bug added subscriber Ubuntu Stable Release Updates Team
2022-12-02 00:54:46 Łukasz Zemczak bug added subscriber SRU Verification
2022-12-02 00:54:49 Łukasz Zemczak tags architecture-s39064 bugnameltc-199411 patch pei-30 severity-medium targetmilestone-inin2004 architecture-s39064 bugnameltc-199411 patch pei-30 severity-medium targetmilestone-inin2004 verification-needed verification-needed-focal
2022-12-02 00:55:40 Łukasz Zemczak removed subscriber Ubuntu Sponsors Team
2022-12-02 00:57:08 Łukasz Zemczak s390-tools-signed (Ubuntu Focal): status Triaged Fix Committed
2022-12-02 14:43:28 Frank Heimes ubuntu-z-systems: status In Progress Fix Committed
2022-12-02 15:46:50 Frank Heimes description SRU Justification: ================== [Impact] * The zgetdump tool (as part of the current s390-tools version in focal) is not able to handle multi-volume dumps (DASD disk) dumps. * While this is rarely needed, it is extremely annoying if one is in usually urgent need to use it and it does not work. * On s390x systems multi-volume (DASD disk) dumps are pretty common, due to usually costly and therefore limited disk resources, DASD disks are usually relatively small. [Fix] * d55b787 d55b787d05eb9bd70f93c36cf859b66b2ad02038 "zgetdump: Fix device node determination via sysfs" [Test Plan] * Have an IBM zSystems LPAR with Ubuntu 20.04 / focal (latest). * Have two (or more) additional DASD disks reserved for storing dumps, assigned to the system and enabled: sudo chzdev -e 0002, 0003 (Assuming 0001 has Ubuntu 20.04 installed - all 3390 disks). Get the block device names using 'lsdasd' - assuming here dasdb, dasdc * If needed low-level format these disks: sudo dasdfmt -y -b 4096 /dev/dasdb sudo dasdfmt -y -b 4096 /dev/dasdc * Create one single partition per disk: fdisk -a /dev/dasdb fdisk -a /dev/dasdc * Create an mvdump.conf file that points to the above disks sudo vi /etc/mvdump.conf ... cat /etc/mvdump.conf /dev/dasdb1 /dev/dasdc1 * Re-write the zipl boot record like this: sudo zipl -n -M /etc/mvdump.conf * Now ipl the system from the first dump DASD: 0002 and initiate the DASD dump by: 1. Stop all CPUs. 2. Store status on the IPL CPU. 3. IPL the dump tool on the IPL CPU. * Wait until the dump is completed and re-ipl the Ubuntu 20.04 again (0001). * Without this fix one will see a message like this: zgetdump -i /dev/dasdb zgetdump: Could not open "/sys/bus/ccw/devices/0.0.0002/dasdb/dev" (No such file or directory) * With the fix one will see a message like this: zgetdump -i /dev/dasdb General dump info: Dump format........: s390mv_ext Version............: 1 Dump created.......: ... Dump device info: Volume 0: 0.0.0002 (online/active) Volume 1: 0.0.0003 (online/valid) * For more in-depth details see the 'Linux on System z. Using the Dump Tools.' documentation: https://www.ibm.com/docs/en/linux-on-systems?topic=dump-hmc-se-example [Where problems could occur] * A new function got introduced to 'check whether a device with a given busid is online'. Issues could occur in case this function is broken and checks for a wrong busid, has a wrong path or handled the status wrongly. * The kind of 'little' refactoring of that patch may lead to further unexpected issues (that can largely identified by a test build). * The additional use of libutil functions may cause issues in case of an outdated libutil that does not offer all needed functions. (Testable with a test build.) * Erroneous code may even break single volume dumps [Other Info] * This code is known to work with hirsute and newer Ubuntu releases, esp. jammy (respectively their s390-tools versions). * The upstream code can be cleanly cherry-picked, hence is applied as-is. * An updated s390-tools version 2.12.0-0ubuntu3.7 with a patched zgetdump tool was build and made available via this PPA: https://launchpad.net/~fheimes/+archive/ubuntu/lp1987387 and was already successfully tested! __________ == Comment: #0 - Thorsten Diehl <thorsten.diehl@de.ibm.com> - 2022-08-16 12:40:46 == I installed Ubuntu 20.04.4 LTS on IBM z14, enabled two DASDs, created one partition on each DASD and created an mvdump.conf file like this: /dev/dasdc1 /dev/dasdd1 I wrote the boot record by zipl -n -M mvdump.conf and IPLed the system from dasdc devno. The dump completed succesfully. Then I tried to get this dump via zgetdump on the restarted Ubuntu 20.04.4 system (zgetdump -v reports version 2.12.0-build-20220506), I got the following error: root@m8330032:~# zgetdump -i /dev/dasdc zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdc1 zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd1 zgetdump: No valid dump found on "/dev/dasdd1" root@m8330032:~# However, If I'm doing the same zgetdump on another system (e.g. with newer s390-tools version), I get the expected result m83lp32:~ # zgetdump -i /dev/dasdc General dump info:   Dump format........: s390mv_ext   Version............: 1   Dump created.......: Tue, 16 Aug 2022 18:31:57 +0200   Dump ended.........: Tue, 16 Aug 2022 18:32:02 +0200   Dump CPU ID........: ff1fa1e739068000   UTS node name......: m8330032.lnxne.boe   UTS kernel release.: 5.4.0-124-generic   UTS kernel version.: #140-Ubuntu SMP Thu Aug 4 02:23:07 UTC 2022   Build arch.........: s390x (64 bit)   System arch........: s390x (64 bit)   CPU count (online).: 16   CPU count (real)...: 16   Dump memory range..: 4096 MB   Real memory range..: 4096 MB   Dump file size.....: 849 MB Memory map:   0000000000000000 - 00000000ffffffff (4096 MB) Dump device info:   Volume 0: 0.0.9405 (online/active)   Volume 1: 0.0.9406 (online/valid) m83lp32:~ # The error is easily reproducible. Please update zgetdump to a newer version to solve this RAS problem. With Jammy (22.04.1; s390-tools version 2.20.0-build-20220623) this problem does not occur. == Comment: #3 - Jan Hoeppner <Jan.Hoeppner@de.ibm.com> - 2022-08-22 01:43:45 == There were several issues fixed in s390-tools v2.15.1 in regards to multivolume dumps: https://github.com/ibm-s390-linux/s390-tools/releases/tag/v2.15.1 Especially the following upstream commit for zgetdump: https://github.com/ibm-s390-linux/s390-tools/commit/d55b787d05eb9bd70f93c36cf859b66b2ad02038 --- External link: https://warthogs.atlassian.net/browse/PEI-30 SRU Justification: ================== [Impact]  * The zgetdump tool (as part of the current s390-tools version in focal)    is not able to handle multi-volume dumps (DASD disk) dumps.  * While this is rarely needed, it is extremely annoying if one is    in usually urgent need to use it and it does not work.  * On s390x systems multi-volume (DASD disk) dumps are pretty common,    due to usually costly and therefore limited disk resources,    DASD disks are usually relatively small. [Fix]  * d55b787 d55b787d05eb9bd70f93c36cf859b66b2ad02038 "zgetdump: Fix device node determination via sysfs" [Test Plan]  * Have an IBM zSystems LPAR with Ubuntu 20.04 / focal (latest).  * Have two (or more) additional DASD disks reserved for storing dumps,    assigned to the system and enabled:    sudo chzdev -e 0002, 0003    (Assuming 0001 has Ubuntu 20.04 installed - all 3390 disks).    Get the block device names using 'lsdasd' - assuming here dasdb, dasdc  * If needed low-level format these disks:    sudo dasdfmt -y -b 4096 /dev/dasdb    sudo dasdfmt -y -b 4096 /dev/dasdc  * Create one single partition per disk:    sudo fdasd -a /dev/dasdb    sudo fdasd -a /dev/dasdc  * Create an mvdump.conf file that points to the above disks    sudo vi /etc/mvdump.conf    ...    cat /etc/mvdump.conf    /dev/dasdb1    /dev/dasdc1  * Re-write the zipl boot record like this:    sudo zipl -n -M /etc/mvdump.conf  * Now ipl the system from the first dump DASD: 0002    and initiate the DASD dump by:    1. Stop all CPUs.    2. Store status on the IPL CPU.    3. IPL the dump tool on the IPL CPU.  * Wait until the dump is completed and re-ipl the Ubuntu 20.04 again (0001).  * Without this fix one will see a message like this:    sudo zgetdump -i /dev/dasdb    zgetdump: Could not open "/sys/bus/ccw/devices/0.0.0002/dasdb/dev" (No such file or directory)  * With the fix one will see a message like this:    zgetdump -i /dev/dasdb    General dump info:      Dump format........: s390mv_ext      Version............: 1      Dump created.......:      ...      Dump device info:        Volume 0: 0.0.0002 (online/active)        Volume 1: 0.0.0003 (online/valid)  * For more in-depth details see the    'Linux on System z. Using the Dump Tools.' documentation:    https://www.ibm.com/docs/en/linux-on-systems?topic=dump-hmc-se-example [Where problems could occur]  * A new function got introduced to 'check whether a device with a given    busid is online'.    Issues could occur in case this function is broken and    checks for a wrong busid, has a wrong path    or handled the status wrongly.  * The kind of 'little' refactoring of that patch may lead to    further unexpected issues (that can largely identified by a test build).  * The additional use of libutil functions may cause issues    in case of an outdated libutil that does not offer all needed functions.    (Testable with a test build.)  * Erroneous code may even break single volume dumps [Other Info]  * This code is known to work with hirsute and newer Ubuntu releases,    esp. jammy (respectively their s390-tools versions).  * The upstream code can be cleanly cherry-picked,    hence is applied as-is.  * An updated s390-tools version 2.12.0-0ubuntu3.7 with a    patched zgetdump tool was build and made available via this PPA:    https://launchpad.net/~fheimes/+archive/ubuntu/lp1987387    and was already successfully tested! __________ == Comment: #0 - Thorsten Diehl <thorsten.diehl@de.ibm.com> - 2022-08-16 12:40:46 == I installed Ubuntu 20.04.4 LTS on IBM z14, enabled two DASDs, created one partition on each DASD and created an mvdump.conf file like this: /dev/dasdc1 /dev/dasdd1 I wrote the boot record by zipl -n -M mvdump.conf and IPLed the system from dasdc devno. The dump completed succesfully. Then I tried to get this dump via zgetdump on the restarted Ubuntu 20.04.4 system (zgetdump -v reports version 2.12.0-build-20220506), I got the following error: root@m8330032:~# zgetdump -i /dev/dasdc zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdc1 zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd zgetdump: Could not open "/sys/bus/ccw/devices/0.0.9405/dasdc/dev" (No such file or directory) root@m8330032:~# zgetdump -i /dev/dasdd1 zgetdump: No valid dump found on "/dev/dasdd1" root@m8330032:~# However, If I'm doing the same zgetdump on another system (e.g. with newer s390-tools version), I get the expected result m83lp32:~ # zgetdump -i /dev/dasdc General dump info:   Dump format........: s390mv_ext   Version............: 1   Dump created.......: Tue, 16 Aug 2022 18:31:57 +0200   Dump ended.........: Tue, 16 Aug 2022 18:32:02 +0200   Dump CPU ID........: ff1fa1e739068000   UTS node name......: m8330032.lnxne.boe   UTS kernel release.: 5.4.0-124-generic   UTS kernel version.: #140-Ubuntu SMP Thu Aug 4 02:23:07 UTC 2022   Build arch.........: s390x (64 bit)   System arch........: s390x (64 bit)   CPU count (online).: 16   CPU count (real)...: 16   Dump memory range..: 4096 MB   Real memory range..: 4096 MB   Dump file size.....: 849 MB Memory map:   0000000000000000 - 00000000ffffffff (4096 MB) Dump device info:   Volume 0: 0.0.9405 (online/active)   Volume 1: 0.0.9406 (online/valid) m83lp32:~ # The error is easily reproducible. Please update zgetdump to a newer version to solve this RAS problem. With Jammy (22.04.1; s390-tools version 2.20.0-build-20220623) this problem does not occur. == Comment: #3 - Jan Hoeppner <Jan.Hoeppner@de.ibm.com> - 2022-08-22 01:43:45 == There were several issues fixed in s390-tools v2.15.1 in regards to multivolume dumps: https://github.com/ibm-s390-linux/s390-tools/releases/tag/v2.15.1 Especially the following upstream commit for zgetdump: https://github.com/ibm-s390-linux/s390-tools/commit/d55b787d05eb9bd70f93c36cf859b66b2ad02038 --- External link: https://warthogs.atlassian.net/browse/PEI-30
2022-12-02 15:56:57 Frank Heimes attachment added focal_verification.txt https://bugs.launchpad.net/ubuntu/+source/s390-tools/+bug/1987387/+attachment/5633960/+files/focal_verification.txt
2022-12-02 15:57:25 Frank Heimes tags architecture-s39064 bugnameltc-199411 patch pei-30 severity-medium targetmilestone-inin2004 verification-needed verification-needed-focal architecture-s39064 bugnameltc-199411 patch pei-30 severity-medium targetmilestone-inin2004 verification-done verification-done-focal
2023-01-23 11:19:10 Launchpad Janitor s390-tools (Ubuntu Focal): status Fix Committed Fix Released
2023-01-23 11:19:13 Launchpad Janitor s390-tools-signed (Ubuntu Focal): status Fix Committed Fix Released
2023-01-23 11:19:22 Łukasz Zemczak removed subscriber Ubuntu Stable Release Updates Team
2023-01-23 11:27:52 Frank Heimes ubuntu-z-systems: status Fix Committed Fix Released
2023-01-23 18:09:52 bugproxy tags architecture-s39064 bugnameltc-199411 patch pei-30 severity-medium targetmilestone-inin2004 verification-done verification-done-focal architecture-s39064 bugnameltc-199411 patch pei-30 severity-medium targetmilestone-inin20045 verification-done verification-done-focal