Activity log for bug #1878973

Date Who What changed Old value New value Message
2020-05-15 18:43:13 Harry Coin bug added bug
2020-05-15 18:44:27 Harry Coin attachment added _usr_sbin_qemu-ga.0.crash https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1878973/+attachment/5372270/+files/_usr_sbin_qemu-ga.0.crash
2020-05-15 19:31:12 Dan Streetman bug added subscriber Dan Streetman
2020-05-15 20:39:43 Kai Kasurinen bug added subscriber Kai Kasurinen
2020-05-18 09:50:35 Christian Ehrhardt  qemu (Ubuntu): status New Incomplete
2020-05-18 09:50:46 Christian Ehrhardt  bug added subscriber Christian Ehrhardt 
2020-06-02 06:09:14 Christian Ehrhardt  qemu (Ubuntu): status Incomplete Confirmed
2020-06-02 06:10:12 Christian Ehrhardt  description Completely new/fresh focal / mate install. Crash during initial apt install of many packages after first log-in, including qemu-guest-agent. No other important load other than apt running. OS running in a vm as a guest (obviously...) No idea what caused it. Including crash report. VM was 2 penryn class cpus with 3G ram. ProblemType: Bug DistroRelease: Ubuntu 20.04 Package: qemu-guest-agent 1:4.2-3ubuntu6 ProcVersionSignature: Ubuntu 5.4.0-29.33-generic 5.4.30 Uname: Linux 5.4.0-29-generic x86_64 ApportVersion: 2.20.11-0ubuntu27 Architecture: amd64 CasperMD5CheckResult: skip CurrentDesktop: MATE Date: Fri May 15 13:20:02 2020 InstallationDate: Installed on 2020-05-13 (1 days ago) InstallationMedia: Ubuntu-MATE 20.04 LTS "Focal Fossa" - Release amd64 (20200423) SourcePackage: qemu UpgradeStatus: No upgrade log present (probably fresh install) It is not yet sure if this triggers a functional issue, but it certainly looks wrong and might trigger a crash dump & report. Taking a Focal system with the version of qemu-guest-agent you reported and then making sure it is installed, up and running: ● qemu-guest-agent.service - QEMU Guest Agent Loaded: loaded (/lib/systemd/system/qemu-guest-agent.service; static; vendor preset: enabled) Active: active (running) since Tue 2020-06-02 05:25:04 UTC; 3min 8s ago Main PID: 624 (qemu-ga) Tasks: 1 (limit: 533) Memory: 900.0K CGroup: /system.slice/qemu-guest-agent.service └─624 /usr/sbin/qemu-ga Pass a shutdown command through virsh: $ virsh shutdown focal --mode agent The guest almost immediately went down, without "functional" issues. But when checking the logs later I found: Jun 02 05:29:54 focal qemu-ga[624]: ERROR:/build/qemu-74sXTC/qemu-4.2/qga/main.c:532:send_response: assertion failed: (rsp && s->channel) Jun 02 05:29:54 focal qemu-ga[624]: Bail out! ERROR:/build/qemu-74sXTC/qemu-4.2/qga/main.c:532:send_response: assertion failed: (rsp && s->channel) --- Completely new/fresh focal / mate install. Crash during initial apt install of many packages after first log-in, including qemu-guest-agent. No other important load other than apt running. OS running in a vm as a guest (obviously...) No idea what caused it. Including crash report.  VM was 2 penryn class cpus with 3G ram. ProblemType: Bug DistroRelease: Ubuntu 20.04 Package: qemu-guest-agent 1:4.2-3ubuntu6 ProcVersionSignature: Ubuntu 5.4.0-29.33-generic 5.4.30 Uname: Linux 5.4.0-29-generic x86_64 ApportVersion: 2.20.11-0ubuntu27 Architecture: amd64 CasperMD5CheckResult: skip CurrentDesktop: MATE Date: Fri May 15 13:20:02 2020 InstallationDate: Installed on 2020-05-13 (1 days ago) InstallationMedia: Ubuntu-MATE 20.04 LTS "Focal Fossa" - Release amd64 (20200423) SourcePackage: qemu UpgradeStatus: No upgrade log present (probably fresh install)
2020-06-02 06:26:07 Christian Ehrhardt  qemu (Ubuntu): importance Undecided Medium
2020-06-04 08:08:42 Christian Ehrhardt  nominated for series Ubuntu Eoan
2020-06-04 08:08:42 Christian Ehrhardt  bug task added qemu (Ubuntu Eoan)
2020-06-04 08:08:42 Christian Ehrhardt  nominated for series Ubuntu Focal
2020-06-04 08:08:42 Christian Ehrhardt  bug task added qemu (Ubuntu Focal)
2020-06-04 13:22:15 Launchpad Janitor qemu (Ubuntu Eoan): status New Confirmed
2020-06-04 13:22:15 Launchpad Janitor qemu (Ubuntu Focal): status New Confirmed
2020-06-04 13:51:50 Christian Ehrhardt  description It is not yet sure if this triggers a functional issue, but it certainly looks wrong and might trigger a crash dump & report. Taking a Focal system with the version of qemu-guest-agent you reported and then making sure it is installed, up and running: ● qemu-guest-agent.service - QEMU Guest Agent Loaded: loaded (/lib/systemd/system/qemu-guest-agent.service; static; vendor preset: enabled) Active: active (running) since Tue 2020-06-02 05:25:04 UTC; 3min 8s ago Main PID: 624 (qemu-ga) Tasks: 1 (limit: 533) Memory: 900.0K CGroup: /system.slice/qemu-guest-agent.service └─624 /usr/sbin/qemu-ga Pass a shutdown command through virsh: $ virsh shutdown focal --mode agent The guest almost immediately went down, without "functional" issues. But when checking the logs later I found: Jun 02 05:29:54 focal qemu-ga[624]: ERROR:/build/qemu-74sXTC/qemu-4.2/qga/main.c:532:send_response: assertion failed: (rsp && s->channel) Jun 02 05:29:54 focal qemu-ga[624]: Bail out! ERROR:/build/qemu-74sXTC/qemu-4.2/qga/main.c:532:send_response: assertion failed: (rsp && s->channel) --- Completely new/fresh focal / mate install. Crash during initial apt install of many packages after first log-in, including qemu-guest-agent. No other important load other than apt running. OS running in a vm as a guest (obviously...) No idea what caused it. Including crash report.  VM was 2 penryn class cpus with 3G ram. ProblemType: Bug DistroRelease: Ubuntu 20.04 Package: qemu-guest-agent 1:4.2-3ubuntu6 ProcVersionSignature: Ubuntu 5.4.0-29.33-generic 5.4.30 Uname: Linux 5.4.0-29-generic x86_64 ApportVersion: 2.20.11-0ubuntu27 Architecture: amd64 CasperMD5CheckResult: skip CurrentDesktop: MATE Date: Fri May 15 13:20:02 2020 InstallationDate: Installed on 2020-05-13 (1 days ago) InstallationMedia: Ubuntu-MATE 20.04 LTS "Focal Fossa" - Release amd64 (20200423) SourcePackage: qemu UpgradeStatus: No upgrade log present (probably fresh install) [Impact] * On shutdown the qemu-guest-agent crashes, that will - trigger the crash reports - throw two errors/warnings into the logs - can cause hang (not seen in all cases) * Since generally the shutdown seems to still work it is "only" medium, maybe high in prio. But really should be resolved to avoid that we find even more severe consequences (like bad guest state tracking into hard kills, I can imagine these) * After outlining the issue above the fix was cerated and is rather small and easy. It applies to E-G as-is. [Test Case] * Create a guest VM with the target release you want to test. Ensure you have the channel for gueqt-agent set up and making sure it is installed, up and running: ● qemu-guest-agent.service - QEMU Guest Agent      Loaded: loaded (/lib/systemd/system/qemu-guest-agent.service; static; vendor preset: enabled)      Active: active (running) since Tue 2020-06-02 05:25:04 UTC; 3min 8s ago    Main PID: 624 (qemu-ga)       Tasks: 1 (limit: 533)      Memory: 900.0K      CGroup: /system.slice/qemu-guest-agent.service              └─624 /usr/sbin/qemu-ga * Pass a shutdown command through virsh:    $ virsh shutdown focal --mode agent An alternative way to trigger the same is: $ virsh qemu-agent-command focal '{"execute": "guest-shutdown"}' The guest almost immediately went down usually, but on reboot you can check the journal of the service and will find the crashes: $ journalctl -u qemu-guest-agent Jun 02 05:29:54 focal qemu-ga[624]: ERROR:/build/qemu-74sXTC/qemu-4.2/qga/main.c:532:send_response: assertion failed: (rsp && s->channel) Jun 02 05:29:54 focal qemu-ga[624]: Bail out! ERROR:/build/qemu-74sXTC/qemu-4.2/qga/main.c:532:send_response: assertion failed: (rsp && s->channel) [Regression Potential] * Formerly qemu was asserting on a bad pointer and exiting non gracefully. That is replaced by a clean handling of the case. The different return path will slightly change behavior - to the better. I can't see an issue that would likely happen - but never the less if we look for regressions they will be on the guest shutdown path. [Other Info] * Hangs got reported by affected users, but yet unable to be reproduced on other systems. --- Completely new/fresh focal / mate install. Crash during initial apt install of many packages after first log-in, including qemu-guest-agent. No other important load other than apt running. OS running in a vm as a guest (obviously...) No idea what caused it. Including crash report.  VM was 2 penryn class cpus with 3G ram. ProblemType: Bug DistroRelease: Ubuntu 20.04 Package: qemu-guest-agent 1:4.2-3ubuntu6 ProcVersionSignature: Ubuntu 5.4.0-29.33-generic 5.4.30 Uname: Linux 5.4.0-29-generic x86_64 ApportVersion: 2.20.11-0ubuntu27 Architecture: amd64 CasperMD5CheckResult: skip CurrentDesktop: MATE Date: Fri May 15 13:20:02 2020 InstallationDate: Installed on 2020-05-13 (1 days ago) InstallationMedia: Ubuntu-MATE 20.04 LTS "Focal Fossa" - Release amd64 (20200423) SourcePackage: qemu UpgradeStatus: No upgrade log present (probably fresh install)
2020-06-10 06:10:38 Christian Ehrhardt  qemu (Ubuntu Eoan): importance Undecided High
2020-06-10 06:10:40 Christian Ehrhardt  qemu (Ubuntu Focal): importance Undecided High
2020-06-10 06:10:44 Christian Ehrhardt  qemu (Ubuntu Eoan): importance High Medium
2020-06-16 16:48:59 Launchpad Janitor qemu (Ubuntu): status Confirmed Fix Released
2020-06-17 05:27:28 Launchpad Janitor merge proposal linked https://code.launchpad.net/~paelzer/ubuntu/+source/qemu/+git/qemu/+merge/385876
2020-06-17 05:39:44 Launchpad Janitor merge proposal linked https://code.launchpad.net/~paelzer/ubuntu/+source/qemu/+git/qemu/+merge/385878
2020-06-17 06:00:42 Kai Kasurinen removed subscriber Kai Kasurinen
2020-06-22 11:23:47 Łukasz Zemczak qemu (Ubuntu Focal): status Confirmed Fix Committed
2020-06-22 11:23:49 Łukasz Zemczak bug added subscriber Ubuntu Stable Release Updates Team
2020-06-22 11:23:53 Łukasz Zemczak bug added subscriber SRU Verification
2020-06-22 11:23:56 Łukasz Zemczak tags amd64 apport-bug focal amd64 apport-bug focal verification-needed verification-needed-focal
2020-06-22 11:27:55 Łukasz Zemczak qemu (Ubuntu Eoan): status Confirmed Fix Committed
2020-06-22 11:27:59 Łukasz Zemczak tags amd64 apport-bug focal verification-needed verification-needed-focal amd64 apport-bug focal verification-needed verification-needed-eoan verification-needed-focal
2020-06-23 09:14:51 Christian Ehrhardt  tags amd64 apport-bug focal verification-needed verification-needed-eoan verification-needed-focal amd64 apport-bug focal verification-done verification-done-eoan verification-done-focal
2020-07-06 14:43:02 Łukasz Zemczak removed subscriber Ubuntu Stable Release Updates Team
2020-07-06 14:43:31 Launchpad Janitor qemu (Ubuntu Eoan): status Fix Committed Fix Released
2020-07-06 14:53:06 Launchpad Janitor qemu (Ubuntu Focal): status Fix Committed Fix Released