ResolutionKMS patch for Wayland (RHBZ#1292234)

[Chris Cheney]

open-vm-tools no longer works for Ubuntu 17.10 now that it uses Wayland.

There is a patch to fix this issue in Fedora 26, which I have attached to this report.

* Sun Apr 02 2017 Ravindra Kumar <email address hidden> - 10.1.5-4
- ResolutionKMS patch for Wayland (RHBZ#1292234).

* Thu Mar 16 2017 Ravindra Kumar <email address hidden> - 10.1.5-3
- Need to add xmlsec1-openssl dependency explicitly.

* Tue Feb 28 2017 Richard W.M. Jones <email address hidden> - 10.1.5-2
- Use 0644 permissions for udev rules file.

* Fri Feb 24 2017 Ravindra Kumar <email address hidden> - 10.1.5-1
- Package new upstream version open-vm-tools-10.1.5-5055683 (RHBZ#1408959).

[Chris Cheney (ccheney)]

Just wondering why open-vm-tools was updated without this patch as its mostly unusable on 17.10 without it, certainly if you are running regular Ubuntu with a desktop interface anyway.

open-vm-tools (2:10.1.5-5055683-5ubuntu1) artful; urgency=low

  * Merge from Debian unstable. Remaining changes:
    - Compile with libxmlsec1-dev instead of xmlsecurity/xerces and thus
    provide VGAuthServices.

 -- Dimitri John Ledkov <email address hidden> Thu, 27 Jul 2017 09:26:39 +0100

[Chris Cheney (ccheney)]

Somewhat interestingly Debian 9.1.0 Gnome works in both regular and Wayland modes with open-vm-tools-desktop 2:10.1.5-5055683-4, but Ubuntu does not.

[Chris Cheney (ccheney)]

Correction:

Debian 9.1.0 Gnome with Wayland does not work after reboot (as I expected without the patch), it appears setting the resolution while in Xorg mode seems to have fixed it for Wayland temporarily.

Ubuntu 17.10 even when not in 'Wayland' mode does not work though. Running "vmware-user-suid-wrapper" just returns without resizing the screen or doing anything else obvious. I'm not sure why its broken in both regular and Wayland modes on Ubuntu maybe something else is wrong with the Ubuntu package as well?

[Ubuntu Foundations Team Bug Bot (crichton)]

The attachment "resolutionKMS-wayland.patch" seems to be a patch. If it isn't, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are a member of the ~ubuntu-reviewers, unsubscribe the team.

[This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issues please contact him.]

[Chris Cheney (ccheney)]

Update:

Looking at the processes while running it appears both 'Ubuntu' and 'Ubuntu on Wayland' modes _both_ run Ubuntu on Wayland in reality. There appears to be no regular X mode in Ubuntu 17.10...

Which makes this patch even more important.

gdm 843 0.0 1.2 271332 48588 tty1 S+ 15:22 0:00 /usr/bin/Xwayland :1024 -rootless -noreset -listen 4 -listen 5 -displayfd 6
ccheney 1345 0.3 1.2 293488 52000 tty2 S+ 15:22 0:00 /usr/bin/Xwayland :0 -rootless -noreset -listen 4 -listen 5 -displayfd 6

[Chris Cheney (ccheney)]

Here are some further bug reports related to this:

https://github.com/vmware/open-vm-tools/issues/22
https://bugzilla.redhat.com/show_bug.cgi?id=1292234
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=872779

Fedora was fixed on Apr 2, and OpenSUSE was fixed a few days ago. Its not clear why open-vm-tools upstream has still not added this patch.

[Bernd Zeimetz (bzed)]

Thats fixed in 2:10.1.10-2, and an segfault in gnome is fixed in 2:10.2.0-2