Activity log for bug #2038249

Date Who What changed Old value New value Message
2023-10-03 03:16:21 Chengen Du bug added bug
2023-10-03 03:17:04 Chengen Du nominated for series Ubuntu Mantic
2023-10-03 03:17:04 Chengen Du bug task added crash (Ubuntu Mantic)
2023-10-03 03:17:04 Chengen Du nominated for series Ubuntu Lunar
2023-10-03 03:17:04 Chengen Du bug task added crash (Ubuntu Lunar)
2023-10-03 03:17:18 Chengen Du crash (Ubuntu Lunar): assignee Chengen Du (chengendu)
2023-10-03 03:17:21 Chengen Du crash (Ubuntu Mantic): assignee Chengen Du (chengendu)
2023-10-03 03:17:29 Chengen Du crash (Ubuntu Lunar): status New In Progress
2023-10-03 03:17:32 Chengen Du crash (Ubuntu Mantic): status New In Progress
2023-10-03 10:01:40 Chengen Du attachment added lp2038249-crash-lunar.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5706209/+files/lp2038249-crash-lunar.debdiff
2023-10-03 10:02:17 Chengen Du attachment added lp2038249-crash-mantic.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5706210/+files/lp2038249-crash-mantic.debdiff
2023-10-03 12:19:21 Ubuntu Foundations Team Bug Bot tags patch
2023-10-03 12:19:25 Ubuntu Foundations Team Bug Bot bug added subscriber Ubuntu Sponsors
2023-10-03 15:18:14 Mauricio Faria de Oliveira removed subscriber Ubuntu Sponsors
2023-10-03 15:18:25 Mauricio Faria de Oliveira bug added subscriber Support Engineering Sponsors
2023-10-17 13:51:38 Mauricio Faria de Oliveira nominated for series Ubuntu Jammy
2023-10-17 13:51:38 Mauricio Faria de Oliveira bug task added crash (Ubuntu Jammy)
2023-10-17 13:51:44 Mauricio Faria de Oliveira crash (Ubuntu Jammy): status New In Progress
2023-10-17 13:51:53 Mauricio Faria de Oliveira crash (Ubuntu Jammy): assignee Chengen Du (chengendu)
2023-10-17 13:51:55 Mauricio Faria de Oliveira crash (Ubuntu Jammy): importance Undecided Medium
2023-10-17 13:51:57 Mauricio Faria de Oliveira crash (Ubuntu Lunar): importance Undecided Medium
2023-10-17 13:51:59 Mauricio Faria de Oliveira crash (Ubuntu Mantic): importance Undecided Medium
2023-10-23 14:29:22 Heitor Alves de Siqueira bug added subscriber Heitor Alves de Siqueira
2023-10-23 14:30:54 Heitor Alves de Siqueira bug added subscriber Ubuntu Sponsors
2023-10-27 19:53:04 Mauricio Faria de Oliveira description [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== [v8.0.0] 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB [v8.0.1] f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing [v8.0.2] d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later 7750e61fdb2a Support module memory layout change on Linux 6.4 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000 /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd: /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command: /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage: crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form) crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario. [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.3++ (8.0.4 development) - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario.
2023-10-27 22:23:01 Mauricio Faria de Oliveira attachment added lp2038249-crash-noble.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5713875/+files/lp2038249-crash-noble.debdiff
2023-10-27 22:27:47 Mauricio Faria de Oliveira crash (Ubuntu): status In Progress Incomplete
2023-10-30 15:26:53 Mauricio Faria de Oliveira bug watch added https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1054805
2023-10-31 19:16:07 Mauricio Faria de Oliveira bug watch added https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1055117
2023-11-06 09:22:32 Chengen Du attachment added lp2038249-crash-jammy.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5716331/+files/lp2038249-crash-jammy.debdiff
2023-11-06 09:23:56 Chengen Du attachment added crash_jammy_test_plan.txt.txt https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5716332/+files/crash_jammy_test_plan.txt.txt
2023-11-06 09:25:08 Chengen Du attachment added lp2038249-crash-lunar.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5716333/+files/lp2038249-crash-lunar.debdiff
2023-11-06 09:26:10 Chengen Du attachment added crash_lunar_test_plan.txt https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5716334/+files/crash_lunar_test_plan.txt
2023-11-06 09:27:47 Chengen Du attachment added lp2038249-crash-mantic.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5716335/+files/lp2038249-crash-mantic.debdiff
2023-11-06 09:28:17 Chengen Du attachment added crash_mantic_test_plan.txt.txt https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5716336/+files/crash_mantic_test_plan.txt.txt
2023-12-10 18:34:35 Mauricio Faria de Oliveira bug added subscriber Mauricio Faria de Oliveira
2023-12-10 18:34:50 Mauricio Faria de Oliveira removed subscriber Ubuntu Sponsors
2023-12-15 10:20:43 Chengen Du crash (Ubuntu): status Incomplete In Progress
2024-01-02 21:35:02 Mauricio Faria de Oliveira crash (Ubuntu Mantic): status In Progress Incomplete
2024-01-02 21:35:04 Mauricio Faria de Oliveira crash (Ubuntu Lunar): status In Progress Incomplete
2024-01-02 21:35:07 Mauricio Faria de Oliveira crash (Ubuntu Jammy): status In Progress Incomplete
2024-01-02 21:35:20 Mauricio Faria de Oliveira crash (Ubuntu): assignee Chengen Du (chengendu) Mauricio Faria de Oliveira (mfo)
2024-01-04 12:32:14 Chengen Du attachment added lp2038249-crash-jammy.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5736414/+files/lp2038249-crash-jammy.debdiff
2024-01-04 12:33:11 Chengen Du attachment added lp2038249-crash-lunar.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5736415/+files/lp2038249-crash-lunar.debdiff
2024-01-04 12:33:58 Chengen Du attachment added lp2038249-crash-mantic.debdiff https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5736416/+files/lp2038249-crash-mantic.debdiff
2024-01-04 12:35:27 Chengen Du attachment added crash_test_plan.txt https://bugs.launchpad.net/ubuntu/+source/crash/+bug/2038249/+attachment/5736417/+files/crash_test_plan.txt
2024-01-04 12:37:36 Chengen Du crash (Ubuntu Jammy): status Incomplete In Progress
2024-01-04 12:37:39 Chengen Du crash (Ubuntu Lunar): status Incomplete In Progress
2024-01-04 12:37:43 Chengen Du crash (Ubuntu Mantic): status Incomplete In Progress
2024-01-09 21:53:05 Mauricio Faria de Oliveira nominated for series Ubuntu Noble
2024-01-09 21:53:05 Mauricio Faria de Oliveira bug task added crash (Ubuntu Noble)
2024-01-09 21:53:16 Mauricio Faria de Oliveira crash (Ubuntu Noble): status In Progress Fix Committed
2024-04-19 17:45:34 Mauricio Faria de Oliveira crash (Ubuntu Noble): status Fix Committed Fix Released
2024-04-19 17:45:46 Mauricio Faria de Oliveira description [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.3++ (8.0.4 development) - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario. [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.4 - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario.
2024-04-19 17:48:04 Mauricio Faria de Oliveira description [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.4 - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario. [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.4 - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] There are detailed/per-commit test plans in the attachments: `crash_jammy_test_plan.txt.txt` and `crash_lunar_test_plan.txt`. And the general sysrq-trigger/makedumpfile/crash test: 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario.
2024-04-19 17:50:49 Mauricio Faria de Oliveira crash (Ubuntu Lunar): status In Progress Won't Fix
2024-04-19 17:50:51 Mauricio Faria de Oliveira crash (Ubuntu Lunar): importance Medium Undecided
2024-04-19 17:50:54 Mauricio Faria de Oliveira crash (Ubuntu Lunar): assignee Chengen Du (chengendu)
2024-04-19 18:09:50 Mauricio Faria de Oliveira description [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.4 - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] There are detailed/per-commit test plans in the attachments: `crash_jammy_test_plan.txt.txt` and `crash_lunar_test_plan.txt`. And the general sysrq-trigger/makedumpfile/crash test: 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario. [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.4 - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] On Jammy (LTS), which provides HWE (6.5) and GA (5.15) kernels, perform testing on both HWE (verify fixes) and GA (verify no regressions). There are detailed/per-commit test plans in the attachments: `crash_jammy_test_plan.txt.txt` and `crash_lunar_test_plan.txt`. And the general sysrq-trigger/makedumpfile/crash test: 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario.
2024-04-20 19:26:15 Mauricio Faria de Oliveira description [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility unable to parse the dump file. ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes issue. ========== In 8.0.1: - 14f8c460473c memory: Handle struct slab changes on Linux 5.17-rc1 and later - 5f390ed811b0 Fix for "kmem -s|-S" and "bt -F[F]" on Linux 5.17-rc1 - b89f9ccf511a Fix for "kmem -s|-S" on Linux 5.17+ with CONFIG_SLAB In 8.0.2: - f02c8e87fccb arm64: use TCR_EL1_T1SZ to get the correct info if vabits_actual is missing In 8.0.3: - d83df2fb66cd SLUB: Fix for offset change of struct slab members on Linux 6.2-rc1 - df1f0cba729f x86_64: Fix for move of per-cpu variables into struct pcpu_hot - 120d6e89fc14 SLAB: Fix for "kmem -s|-S" options on Linux 6.1 and later - ac96e17d1de5 SLAB: Fix for "kmem -s|-S" options on Linux 6.2-rc1 and later In 8.0.4 - 7750e61fdb2a Support module memory layout change on Linux 6.4 - 88580068b7dd Fix failure of gathering task table on Linux 6.5-rc1 and later - 4ee56105881d Fix compilation error due to new strlcpy function that glibc added ========== [Test Plan] On Jammy (LTS), which provides HWE (6.5) and GA (5.15) kernels, perform testing on both HWE (verify fixes) and GA (verify no regressions). There are detailed/per-commit test plans in the attachments: `crash_jammy_test_plan.txt.txt` and `crash_lunar_test_plan.txt`. And the general sysrq-trigger/makedumpfile/crash test: 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario. [Impact] Linux kernel 6.2 includes patches with structural changes that may render the crash utility in Mantic (release kernel 6.5) and Jammy (HWE kernel 6.5) unable to parse the dump file. For example (there are more, in other areas): ========== d122019bf061 mm: Split slab into its own type 401fb12c68c2 mm: Differentiate struct slab fields by sl*b implementations 07f910f9b729 mm: Remove slab from struct page 0d9b1ffefabe arm64: mm: make vabits_actual a build time constant if possible e36ce448a08d mm/slab: use kmalloc_node() for off slab freelist_idx_t array allocation 130d4df57390 mm/sl[au]b: rearrange struct slab fields to allow larger rcu_head ac3b43283923 module: replace module_layout with module_memory b69f0aeb0689 pid: Replace struct pid 1-element array with flex-array ========== [Fix] It is advisable to adopt commits that address the structural changes: - 10 patches from crash 8.0.1 into Jammy - 02 patches from crash 8.0.2 into Jammy - 12 patches from crash 8.0.3 into Jammy/Mantic - 12 patches from crash 8.0.4 into Jammy/Mantic [Test Plan] On Jammy (LTS), which provides HWE (6.5) and release/GA (5.15) kernels, perform testing on both HWE (verify fixes) and GA (verify no regressions). There are detailed/per-commit test plans in the attachments: `crash_jammy_test_plan.txt.txt` and `crash_lunar_test_plan.txt`. A. Test the live mode (live-system form; without a dumpfile), and B. Test the dump mode (dumpfile form: sysrq-trigger/makedumpfile/crash): 1. Install the required packages and then proceed to reboot the machine. # sudo apt install crash linux-crashdump -y # reboot 2. To check the status of kdump, use the `kdump-config show` command. # kdump-config show DUMP_MODE: kdump USE_KDUMP: 1 KDUMP_COREDIR: /var/crash crashkernel addr: 0x64000000    /var/lib/kdump/vmlinuz: symbolic link to /boot/vmlinuz-6.2.0-33-generic kdump initrd:    /var/lib/kdump/initrd.img: symbolic link to /var/lib/kdump/initrd.img-6.2.0-33-generic current state: ready to kdump kexec command:   /sbin/kexec -p --command-line="BOOT_IMAGE=/boot/vmlinuz-6.2.0-33-generic root=UUID=3e72f5d5-870b-4b8e-9a0d-8ba920391379 ro console=tty1 console=ttyS0 reset_devices systemd.unit=kdump-tools-dump.service nr_cpus=1 irqpoll usbcore.nousb" --initrd=/var/lib/kdump/initrd.img /var/lib/kdump/vmlinuz 3. To trigger a crash dump forcefully, execute the `echo c | sudo tee /proc/sysrq-trigger` command. 4. Download the kernel .ddeb file, which will be used for analyzing the dump file. # sudo -i # cd /var/crash # pull-lp-ddebs linux-image-unsigned-$(uname -r) # dpkg-deb -x linux-image-unsigned-$(uname -r)-*.ddeb dbgsym-$(uname -r) 5. Utilize the "crash" utility to parse and analyze the dump file. crash 8.0.0 Copyright (C) 2002-2021 Red Hat, Inc. Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation Copyright (C) 1999-2006 Hewlett-Packard Co Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited Copyright (C) 2006, 2007 VA Linux Systems Japan K.K. Copyright (C) 2005, 2011, 2020-2021 NEC Corporation Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc. Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc. Copyright (C) 2015, 2021 VMware, Inc. This program is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Enter "help copying" to see the conditions. This program has absolutely no warranty. Enter "help warranty" for details. WARNING: VA_BITS: calculated: 46 vmcoreinfo: 48 GNU gdb (GDB) 10.2 Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "aarch64-unknown-linux-gnu". Type "show configuration" for configuration details. Find the GDB manual and other documentation resources online at:     <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... crash: seek error: kernel virtual address: ffffd59a92d48ae8 type: "possible" WARNING: cannot read cpu_possible_map crash: seek error: kernel virtual address: ffffd59a92d48b68 type: "present" WARNING: cannot read cpu_present_map crash: seek error: kernel virtual address: ffffd59a92d48aa8 type: "online" WARNING: cannot read cpu_online_map crash: seek error: kernel virtual address: ffffd59a92d48bb0 type: "active" WARNING: cannot read cpu_active_map crash: seek error: kernel virtual address: ffffd59a93288928 type: "shadow_timekeeper xtime_sec" crash: seek error: kernel virtual address: ffffd59a9317b8f0 type: "init_uts_ns" crash: dbgsym-6 and 202309251539/dump.202309251539 do not match! Usage:   crash [OPTION]... NAMELIST MEMORY-IMAGE[@ADDRESS] (dumpfile form)   crash [OPTION]... [NAMELIST] (live system form) Enter "crash -h" for details. [Where problems could occur] Significant structural changes have occurred between Linux kernel versions 5.15 and 6.2. We are only incorporating patches to ensure the functionality of the "crash" command. However, please be aware that these patches will alter the parsing logic and could potentially result in the "crash" utility being unable to parse the dump file in the worst-case scenario.
2024-05-09 15:09:43 Joao Andre Simioni bug added subscriber Joao Andre Simioni
2024-05-10 13:03:49 Timo Aaltonen crash (Ubuntu Mantic): status In Progress Fix Committed
2024-05-10 13:03:51 Timo Aaltonen bug added subscriber Ubuntu Stable Release Updates Team
2024-05-10 13:03:52 Timo Aaltonen bug added subscriber SRU Verification
2024-05-10 13:04:07 Timo Aaltonen tags patch patch verification-needed verification-needed-mantic
2024-05-10 13:04:39 Timo Aaltonen crash (Ubuntu Jammy): status In Progress Fix Committed
2024-05-10 13:04:48 Timo Aaltonen tags patch verification-needed verification-needed-mantic patch verification-needed verification-needed-jammy verification-needed-mantic
2024-05-11 06:37:06 Chengen Du tags patch verification-needed verification-needed-jammy verification-needed-mantic patch verification-done verification-done-jammy verification-done-mantic
2024-06-05 10:34:41 Launchpad Janitor crash (Ubuntu Mantic): status Fix Committed Fix Released
2024-06-05 10:34:45 Robie Basak removed subscriber Ubuntu Stable Release Updates Team
2024-06-05 10:34:50 Launchpad Janitor crash (Ubuntu Jammy): status Fix Committed Fix Released