vulkan-smoketest segfaults steam vulkan games segfault

[Lawrence A Fossi]

$ lsb_release -rd
Description: Ubuntu Artful Aardvark (development branch)
Release: 17.10

$ apt-cache policy mesa-vulkan-drivers
mesa-vulkan-drivers:
  Installed: 17.2.1-0ubuntu1
  Candidate: 17.2.1-0ubuntu1
  Version table:
 *** 17.2.1-0ubuntu1 500
        500 http://us.archive.ubuntu.com/ubuntu artful/universe amd64 Packages
        100 /var/lib/dpkg/status

Easily reproducible : apt-get install mesa-vulkan-drivers apt-get install vulkan-utils

Open a terminal type vulkan-smoketest instead of a glxgears type window it will segfault.
message from kernel.log:
Sep 29 16:23:53 Tardis-1 kernel: [17709.532915] vulkan-smoketes[11798]: segfault at 0 ip 00007fed61a17914 sp 00007ffedcb8f850 error 6 in libvulkan_radeon.so[7fed619ab000+18b000]
syslog:
Sep 28 10:38:13 Tardis-1 kernel: [18292.174313] vulkan-smoketes[13385]: segfault at 0 ip 00007f62705a7914 sp 00007ffd0edc6260 error 6 in libvulkan_radeon.so[7f627053b000+18b000]

What should happen is a glxgears like window will open and render properly instead of segfaulting.
It appears that the culprit is an old or broken libvulkan_radeon.so provided by mesa-vulkan-drivers.

As a test I renamed the old lib and dropped in a newer version from oibaf's ppa. smoketest now passes steam's The Talos Princible and Mad Max now work properly in Vulkan mode as well instead of segfaulting.

This issue is also present on Zesty and fixed in both Oibaf's and Padoka's ppa's since April back when they were rolling 17.2 mesa.

I have no idea if libvulkan_intel.so also needs updating no hardware to check.

[Lawrence A Fossi (darkfoss)]

Original Talos log before swapping libdrm_radeon.so

[Lawrence A Fossi (darkfoss)]

System at a glance:

OS: Ubuntu 17.10 artful
Kernel: x86_64 Linux 4.13.0-12-generic
Uptime: 1d 5h 28m
Packages: 1846
Shell: bash 4.4.12
DE: GNOME
WM: GNOME Shell
WM Theme: Adwaita
GTK Theme: Ambiance [GTK2/3]
Icon Theme: Adwaita
Font: Ubuntu 11
CPU: AMD FX-8350 Eight-Core @ 8x 4GHz [27.0°C]
MB: CROSSHAIR V FORMULA-Z, BIOS 2201 03/23/2015
RAM:Crucial Ballistix Elite 16GB DDR3@1866 ===|===2005MiB / 16021MiB
GPU: AMD Radeon (TM) R9 Fury Series (AMD FIJI / DRM 3.18.0 / 4.13.0-12-generic, LLVM 5.0.0)
Monitor: Samsung S23A950D (16:9) 119.98 Hz displayport
Resolution: 1920x1080

[Timo Aaltonen (tjaalton)]

works fine on intel. mesa 17.2.2 is uploaded to the queue

[Lawrence A Fossi (darkfoss)]

After seeing you comment last night I did an apt-get purge of mesa-vulkan drivers and vulkan-utils then ran apt-get autoremove to remove libvulkan1 verified that all vulkan related files were gone then rebooted and reinstalled them.

Mesa upgraded fine to 17.2.2 this morning but the problem remains.
$ apt-cache policy mesa-vulkan-drivers
mesa-vulkan-drivers:
  Installed: 17.2.2-0ubuntu1
  Candidate: 17.2.2-0ubuntu1
  Version table:
 *** 17.2.2-0ubuntu1 500
        500 http://us.archive.ubuntu.com/ubuntu artful/universe amd64 Packages
        100 /var/lib/dpkg/status

vulkan-smoketest
WARNING: radv is not a conformant vulkan implementation, testing use only.
WARNING: radv is not a conformant vulkan implementation, testing use only.
Segmentation fault

from kernel log: Oct 5 10:22:17 Tardis-1 kernel: [ 4445.683796] vulkan-smoketes[4128]: segfault at 0 ip 00007f43321ef924 sp 00007ffdee3530a0 error 6 in libvulkan_radeon.so[7f4332183000+18b000]

from syslog: Oct 5 10:22:17 Tardis-1 kernel: [ 4445.683796] vulkan-smoketes[4128]: segfault at 0 ip 00007f43321ef924 sp 00007ffdee3530a0 error 6 in libvulkan_radeon.so[7f4332183000+18b000]

[Timo Aaltonen (tjaalton)]

ok, would you mind filing it upstream then? https://bugs.freedesktop.org -- Mesa, Drivers/Vulkan/radeon

[Lawrence A Fossi (darkfoss)]

I didn't realize there was libvulkan-dev package available I did another purge/clean install including the dev file and noticed there was extra information in vulkaninfo after..My appologies for forgetting to include one initially.
It comes down to 4 extensions not seen/available with the supplied libvulkan_radeon.so that become available once I drop in Oibaf's libvulkan_radeon.so . They are :

===============4 missing from default===========

 VK_KHR_image_format_list : extension revision 1
 VK_KHR_bind_memory2 : extension revision 1
 VK_AMD_rasterization_order : extension revision 1
 VK_KHX_multiview : extension revision 1

Hopefully the above might be helpful if a bit late

[Lawrence A Fossi (darkfoss)]

Vulkan info with oiba'f lib

[Lawrence A Fossi (darkfoss)]

missing 4 side by side.
If you still want me to file upstream I will.

[Lawrence A Fossi (darkfoss)]

After looking at the khronos registry spec VK_AMD_rasterization_order : extension revision 1
seems to be the key to have basic vulkan support on mesa 17.2.2 for amd cards. The other 3 are too new.

I guess this isn't really a bug but more of a much needed feature request to enable it. That would be Ubuntu's decision to make wouldn't it rather than an upstream one?

[Timo Aaltonen (tjaalton)]

no, missing extensions shouldn't make it crash, and even so it's an upstream bug and nothing Ubuntu can do about but pull new versions when they happen.

[Lawrence A Fossi (darkfoss)]

Fair enough Thank you.

[Steven Ragan (stevecragan)]

Isn't this already fixed upstream? If I use the Debian package (https://packages.debian.org/sid/mesa-vulkan-drivers) which is Mesa 17.2.3 it works fine for me, but if I switch back to Ubuntu's package it segfaults.

[Timo Aaltonen (tjaalton)]

sooo, turns out this is caused by debian/patches/vulkan-mir.patch, which needs to be either dropped or updated to cover radv too

[Lawrence A Fossi (darkfoss)]

Thanks for the update. I'm glad to see I wasn't imagining things or a user/hardware issue on my end.
When Ubuntu updated the mesa packages to 17.2.2 I made sure apport had the extra packages installed it needed. I also manually installed the 4 vulkan ddbug packages before running the vulkan-smoketest. Apport kicked in and auto-reported it. Hopefully that generated report helped since it does a far better job that my first attempt.

After I rebuilt the Ubuntu vulkan-utils package and used quilt to restore the amd mesa source but was unable to rebuilt mesa for the mesa vulkan drivers so was unable to test them. I had observed what the patch was doing and came to the decision that radv was being disabled by design. Thats why I didn't report upstream I didn't want to waste dev time for what appeared to be a packaging choice. My apologies for that.

[Timo Aaltonen (tjaalton)]

a new version has been uploaded to xenial/artful/bionic, and for X/A you can find it also on the updates ppa:

https://launchpad.net/~ubuntu-x-swat/+archive/ubuntu/updates

(artful still building ATM)

[Lawrence A Fossi (darkfoss)]

Awesome Thank you. I'll revert from Oibaf's ppa later today looking forward to checking them out

[Lawrence A Fossi (darkfoss)]

I added the ppa vulkan-smoketest now runs correctly as well as The Talos Principle. Just one issue left vulkaninfo shows an elf class error on both of the mesa-vulkan-drivers:i386 packages

[Timo Aaltonen (tjaalton)]

thanks for testing!

32bit drivers need 32bit vulkaninfo, and I don't know how to provide that for 64bit.. so it's a non-issue right now

[Lawrence A Fossi (darkfoss)]

to be specific the libvulkan_intel.so and libvulkan_radeon.so i386 provided by mesa-vulkan-drivers:i386

also works great with $ uname -a
Linux 4.14.0-041400rc8-generic #201711052313 SMP Sun Nov 5 23:14:08 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

[Lawrence A Fossi (darkfoss)]

Didn't see your last post no worries I'm not really too concerned about i386 was just trying to be as complete as possible. I just ran The Talos Princible in moddable version non x64 and it completed just fine despite the elf class warning no loss of fps or any visible graphical errors so really not a big issue. Thank you can't wait for 17.2.4 to hit the official update repo's.
As far as I'm comcerned issues fixed.

[Pierre-Loup A. Griffais (plagman)]

When should we expect the baseline mesa-vulkan-drivers to get that patch for all users of the regular repository? Just so our support agents know what to tell affected Ubuntu users.

[Timo Aaltonen (tjaalton)]

After the package has been reviewed and accepted to enter -proposed it'll usually take 7 days before an update is allowed to enter -updates, assuming it was verified to fix the issue during that period.

[Chris Halse Rogers (raof)]

Hello Lawrence, or anyone else affected,

Accepted mesa into artful-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/mesa/17.2.4-0ubuntu1~17.10.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-artful to verification-done-artful. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-artful. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Launchpad Janitor (janitor)]

This bug was fixed in the package mesa - 17.2.4-0ubuntu2

---------------
mesa (17.2.4-0ubuntu2) bionic; urgency=medium

  * Import changes from 17.2.2-0ubuntu2
  * Make mesa-va-drivers enhance libva2 rather than libva1.
  * vulkan-mir.patch: Dropped, breaks radeon vulkan driver. (LP: #1720890)

 -- Timo Aaltonen <email address hidden> Wed, 08 Nov 2017 16:29:58 +0200

[Adam Conrad (adconrad)]

Hello Lawrence, or anyone else affected,

Accepted mesa into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/mesa/17.2.4-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-xenial to verification-done-xenial. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-xenial. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Lawrence A Fossi (darkfoss)]

Sorry to get back so late with the holiday and a few days testing.
17.2.4-proposed is working fine on:
lsb_release -rd
Description: Ubuntu 17.10
Release: 17.10

vulkan-smoketest now runs without issues. Radv works well with The Talos Priciple no performance loss/visual artifacts on multiple benches manually or with Phoronix test Suite compared to oibaf/padoka ppa's during their 17.2.x mesa runs.
OpenGL performance is unaffected.
Dvd playback was fine as well as streaming such as Netflix.

There were several packages all :i386 removed during the installation possibly induced by myself since it was the first time I have ever used aptitude.
 Removing libmirclient9:i386 (0.28.0+17.10.20171011.1-0ubuntu1) ...
Removing libmircommon7:i386 (0.28.0+17.10.20171011.1-0ubuntu1) ...
Removing libboost-filesystem1.62.0:i386 (1.62.0+dfsg-4build3) ...
Removing libmircore1:i386 (0.28.0+17.10.20171011.1-0ubuntu1) ...
Removing libboost-system1.62.0:i386 (1.62.0+dfsg-4build3) ...
Removing libcapnp-0.5.3:i386 (0.5.3-2ubuntu2) ...
Removing libmirprotobuf3:i386 (0.28.0+17.10.20171011.1-0ubuntu1) ...
Removing libprotobuf-lite10:i386 (3.0.0-9ubuntu5) ...
Removing libxkbcommon0:i386 (0.7.1-2) ...

Tested with kernels : 4.13.0-17
4.15.0-041500rc1, performance increase with rc1 is amazing.

Issue is fixed with no regression on my system.

[Florian W. (florian-will)]

Using artful, I updated these packages (everything that used to have version "17.2.2-0ubuntu1" on my system) to version "17.2.4-0ubuntu1~17.10.1" from -proposed:
libegl1-mesa:amd64 libgbm1:amd64 libgl1-mesa-dev:amd64 libgl1-mesa-dri:amd64 libgl1-mesa-dri:i386 libgl1-mesa-glx:amd64 libgl1-mesa-glx:i386 libglapi-mesa:amd64 libglapi-mesa:i386 libgles2-mesa:amd64 libwayland-egl1-mesa:amd64 libxatracker2:amd64 mesa-common-dev:amd64 mesa-vdpau-drivers:amd64 mesa-vulkan-drivers:amd64

After a reboot, I can confirm Lawrence's observation that vulkan-smoketest segfaulted on the old version, but seems to work fine using the version from -proposed.

Since Lawrence forgot to remove the verification-needed-artful tag, I'm going to remove it now.

[Timo Aaltonen (tjaalton)]

please test xenial too

[Łukasz Zemczak (sil2100)]

Lawrence/Florian: could one of you verify if the xenial-proposed mesa package also fixes the issue on a xenial system? This is blocking the mesa release for this series.

[Timo Aaltonen (tjaalton)]

I've verified it on xenial (had to fight to get vulkan running on an old card)

one issue was that vulkan-utils in xenial doesn't have vulkan-smoketest for easy testing, so had to backport the artful version first. The old driver would just segfault the test, new one starts the app fine and works great.

[Launchpad Janitor (janitor)]

This bug was fixed in the package mesa - 17.2.4-0ubuntu1~16.04.2

---------------
mesa (17.2.4-0ubuntu1~16.04.2) xenial; urgency=medium

  * control: Relax build-dep on libclc-dev

 -- Timo Aaltonen <email address hidden> Wed, 22 Nov 2017 16:25:17 +0200

[Łukasz Zemczak (sil2100)]

Hello Lawrence, or anyone else affected,

Accepted mesa into artful-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/mesa/17.2.4-0ubuntu1~17.10.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-artful to verification-done-artful. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-artful. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

[Timo Aaltonen (tjaalton)]

i've tested artful too, marking verified

[Launchpad Janitor (janitor)]

This bug was fixed in the package mesa - 17.2.4-0ubuntu1~17.10.2

---------------
mesa (17.2.4-0ubuntu1~17.10.2) artful; urgency=medium

  * i965-disable-l3-cache-alloc-for-ext-buffers.diff:
    - Replaced with five backported commits from upstream
      (LP: #1727401, #1735594)

mesa (17.2.4-0ubuntu1~17.10.1) artful; urgency=medium

  * Backport to artful.
  * vulkan-mir.patch: Dropped, breaks radeon vulkan driver. (LP:
    #1720890)

mesa (17.2.4-0ubuntu1) bionic; urgency=medium

  * New upstream bugfix release. (LP: #1727390)
  * i965-disable-l3-cache-alloc-for-ext-buffers.diff: Fix corruption
    running windowed 3D apps on dGPU. (LP: #1727401)

 -- Timo Aaltonen <email address hidden> Tue, 09 Jan 2018 15:28:48 +0200

[Łukasz Zemczak (sil2100)]

The verification of the Stable Release Update for mesa has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.