Activity log for bug #1746088

Date Who What changed Old value New value Message
2018-01-29 20:30:15 bugproxy bug added bug
2018-01-29 20:30:17 bugproxy tags architecture-ppc64le bugnameltc-163583 severity-critical targetmilestone-inin16044
2018-01-29 20:30:40 bugproxy attachment added sosreport https://bugs.launchpad.net/bugs/1746088/+attachment/5045193/+files/sosreport-ltc-briggs1.163583-20180115061751.tar.xz
2018-01-29 20:30:41 bugproxy ubuntu: assignee Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage)
2018-01-29 20:30:46 bugproxy affects ubuntu crash (Ubuntu)
2018-01-30 06:57:42 Frank Heimes bug task added ubuntu-power-systems
2018-01-30 06:58:01 Frank Heimes ubuntu-power-systems: importance Undecided Critical
2018-01-30 06:58:18 Frank Heimes ubuntu-power-systems: assignee Canonical Kernel Team (canonical-kernel-team)
2018-01-30 06:58:31 Frank Heimes tags architecture-ppc64le bugnameltc-163583 severity-critical targetmilestone-inin16044 architecture-ppc64le bugnameltc-163583 severity-critical targetmilestone-inin16044 triage-g
2018-02-05 14:37:08 Manoj Iyer crash (Ubuntu): assignee Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage) Canonical Kernel Team (canonical-kernel-team)
2018-02-05 14:37:13 Manoj Iyer ubuntu-power-systems: status New Triaged
2018-02-05 14:37:18 Manoj Iyer crash (Ubuntu): importance Undecided Critical
2018-02-14 10:43:08 Thadeu Lima de Souza Cascardo bug added subscriber Thadeu Lima de Souza Cascardo
2018-02-15 16:38:33 Thadeu Lima de Souza Cascardo crash (Ubuntu): status New In Progress
2018-02-15 16:38:37 Thadeu Lima de Souza Cascardo crash (Ubuntu): assignee Canonical Kernel Team (canonical-kernel-team) Thadeu Lima de Souza Cascardo (cascardo)
2018-02-19 10:03:37 Thadeu Lima de Souza Cascardo nominated for series Ubuntu Bionic
2018-02-19 10:03:37 Thadeu Lima de Souza Cascardo nominated for series Ubuntu Xenial
2018-02-19 10:03:37 Thadeu Lima de Souza Cascardo nominated for series Ubuntu Artful
2018-02-22 20:32:03 Joseph Salisbury bug task added crash (Ubuntu Artful)
2018-02-22 20:32:12 Joseph Salisbury bug task added crash (Ubuntu Bionic)
2018-02-22 20:32:21 Joseph Salisbury bug task added crash (Ubuntu Xenial)
2018-03-05 14:00:32 Thadeu Lima de Souza Cascardo crash (Ubuntu Bionic): status In Progress Fix Released
2018-03-05 14:55:12 Manoj Iyer crash (Ubuntu Xenial): assignee Canonical Kernel Team (canonical-kernel-team)
2018-03-05 14:55:21 Manoj Iyer crash (Ubuntu Artful): assignee Canonical Kernel Team (canonical-kernel-team)
2018-03-05 14:55:23 Manoj Iyer crash (Ubuntu Xenial): importance Undecided Critical
2018-03-05 14:55:25 Manoj Iyer crash (Ubuntu Artful): importance Undecided Critical
2018-03-06 08:02:00 Thadeu Lima de Souza Cascardo crash (Ubuntu Artful): status New In Progress
2018-03-08 15:45:43 Frank Heimes tags architecture-ppc64le bugnameltc-163583 severity-critical targetmilestone-inin16044 triage-g architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g
2018-03-08 16:00:23 bugproxy attachment added sosreport https://bugs.launchpad.net/bugs/1746088/+attachment/5073134/+files/sosreport-ltc-briggs1.163583-20180115061751.tar.xz
2018-05-14 16:57:52 Frank Heimes tags architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-a
2018-05-14 16:58:16 Frank Heimes ubuntu-power-systems: status Triaged In Progress
2018-06-11 13:37:33 Manoj Iyer tags architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-a architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g
2018-07-12 20:53:52 Thadeu Lima de Souza Cascardo description ---Problem Description--- Unable to analyze the vmcore generated by kdump on 4.13.0-26-generic kernel (Ubuntu 16.04.4) ---uname output--- Linux ltc-briggs1 4.13.0-26-generic #29~16.04.2-Ubuntu SMP Tue Jan 9 21:40:36 UTC 2018 ppc64le ppc64le ppc64le GNU/Linux Machine Type = 8001-22C ---Steps to Reproduce--- This bug follow up bug of https://bugzilla.linux.ibm.com/show_bug.cgi?id=163565 The steps to create dump is as follows Once you generate the kdump use crash to analyze the vmcore and we get this error ================console logs ========== root@ltc-briggs1:/var/crash/201801150227# ls dmesg.201801150227 vmcore.201801150227 .0-26-generic vmcore.2018011502271150227# crash /usr/lib/debug/boot/vmlinux-4.13. crash 7.1.4 Copyright (C) 2002-2015 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. GNU gdb (GDB) 7.6 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "powerpc64le-unknown-linux-gnu"... please wait... (gathering module symbol data) WARNING: cannot access vmalloc'd module memory crash: invalid structure member offset: thread_info_task FILE: task.c LINE: 598 FUNCTION: irqstacks_init() [/usr/bin/crash] error trace: 1008ade0 => 1011552c => 1017d220 => 100833e0 100833e0: (undetermined) 1017d220: OFFSET_verify+80 1011552c: task_init+5084 1008ade0: main_loop+336 == Comment from Hari Krishna Bathini == There are quite a few commits (all available upstream) that are needed for crash tool to work fine. I think the right thing to do here would be to use the latest crash tool version 7.2.0 to go with the kernel update. Also, the below commit would be needed on top of 7.2.0 crash utility: commit c8178eca9c74f81a7f803a58d339635cc152e8d9 Author: Dave Anderson <anderson@redhat.com> Date: Thu Nov 9 11:39:05 2017 -0500 Update for support of Linux 4.14 and later PPC64 kernels where the hash page table geometry accomodates a larger virtual address range. Without the patch, the virtual-to-physical translation of user space virtual addresses by "vm -p", "vtop", and "rd -u" may generate an invalid translation or otherwise fail. (hbathini@linux.vnet.ibm.com) Similar thing holds true for makedumpfile tool.. Thanks Hari [Impact] It won't be possible to analyze dumps produced by newer kernels (hwe on xenial, for example). [Test Case] Tested that this version of crash can analyze both GA (4.4) and hwe (4.15) kernels. [Regression Potential] New crash versions may have bugs and some commands not work with older kernels. The smoke test helps a little, but more testing may be desirable. ---Problem Description--- Unable to analyze the vmcore generated by kdump on 4.13.0-26-generic kernel (Ubuntu 16.04.4) ---uname output--- Linux ltc-briggs1 4.13.0-26-generic #29~16.04.2-Ubuntu SMP Tue Jan 9 21:40:36 UTC 2018 ppc64le ppc64le ppc64le GNU/Linux Machine Type = 8001-22C ---Steps to Reproduce---  This bug follow up bug of https://bugzilla.linux.ibm.com/show_bug.cgi?id=163565 The steps to create dump is as follows Once you generate the kdump use crash to analyze the vmcore and we get this error ================console logs ========== root@ltc-briggs1:/var/crash/201801150227# ls dmesg.201801150227 vmcore.201801150227 .0-26-generic vmcore.2018011502271150227# crash /usr/lib/debug/boot/vmlinux-4.13. crash 7.1.4 Copyright (C) 2002-2015 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. GNU gdb (GDB) 7.6 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "powerpc64le-unknown-linux-gnu"... please wait... (gathering module symbol data) WARNING: cannot access vmalloc'd module memory crash: invalid structure member offset: thread_info_task        FILE: task.c LINE: 598 FUNCTION: irqstacks_init() [/usr/bin/crash] error trace: 1008ade0 => 1011552c => 1017d220 => 100833e0   100833e0: (undetermined)   1017d220: OFFSET_verify+80   1011552c: task_init+5084   1008ade0: main_loop+336 == Comment from Hari Krishna Bathini == There are quite a few commits (all available upstream) that are needed for crash tool to work fine. I think the right thing to do here would be to use the latest crash tool version 7.2.0 to go with the kernel update. Also, the below commit would be needed on top of 7.2.0 crash utility:   commit c8178eca9c74f81a7f803a58d339635cc152e8d9   Author: Dave Anderson <anderson@redhat.com>   Date: Thu Nov 9 11:39:05 2017 -0500     Update for support of Linux 4.14 and later PPC64 kernels where the     hash page table geometry accomodates a larger virtual address range.     Without the patch, the virtual-to-physical translation of user space     virtual addresses by "vm -p", "vtop", and "rd -u" may generate an     invalid translation or otherwise fail.     (hbathini@linux.vnet.ibm.com) Similar thing holds true for makedumpfile tool.. Thanks Hari
2018-07-16 13:41:18 Manoj Iyer crash (Ubuntu Artful): status In Progress Won't Fix
2018-07-23 13:39:14 Łukasz Zemczak crash (Ubuntu Xenial): status New Fix Committed
2018-07-23 13:39:16 Łukasz Zemczak bug added subscriber Ubuntu Stable Release Updates Team
2018-07-23 13:39:18 Łukasz Zemczak bug added subscriber SRU Verification
2018-07-23 13:39:22 Łukasz Zemczak tags architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g verification-needed verification-needed-xenial
2018-07-23 13:45:01 Andrew Cloke tags architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g verification-needed verification-needed-xenial architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-a
2018-07-23 16:17:16 Andrew Cloke ubuntu-power-systems: status In Progress Fix Committed
2018-07-25 17:37:09 Andrew Cloke tags architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-a architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-a verification-needed verification-needed-xenial
2018-07-25 17:37:54 Andrew Cloke tags architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-a verification-needed verification-needed-xenial architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g verification-needed verification-needed-xenial
2018-09-04 09:20:16 bugproxy tags architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g verification-needed verification-needed-xenial architecture-ppc64le bugnameltc-163583 ppc64el-kdump severity-critical targetmilestone-inin16044 triage-g verification-done verification-done-xenial
2018-09-06 09:21:24 Łukasz Zemczak removed subscriber Ubuntu Stable Release Updates Team
2018-09-06 09:21:22 Launchpad Janitor crash (Ubuntu Xenial): status Fix Committed Fix Released
2018-09-06 10:27:47 Andrew Cloke ubuntu-power-systems: status Fix Committed Fix Released
2018-10-10 18:33:37 Steve Langasek crash (Ubuntu Bionic): status Fix Released Triaged
2018-10-10 18:54:56 Andrew Cloke ubuntu-power-systems: status Fix Released Triaged
2018-11-12 17:01:06 Thadeu Lima de Souza Cascardo crash (Ubuntu Bionic): status Triaged In Progress
2018-11-12 19:31:31 Terry Rudd bug added subscriber Terry Rudd
2018-11-19 14:35:26 Andrew Cloke ubuntu-power-systems: status Triaged In Progress
2018-12-18 13:36:14 Thadeu Lima de Souza Cascardo bug added subscriber Ubuntu Stable Release Updates Team
2018-12-21 17:41:49 Thadeu Lima de Souza Cascardo crash (Ubuntu Bionic): status In Progress Invalid
2018-12-28 17:57:45 Andrew Cloke ubuntu-power-systems: status In Progress Fix Released