gst-vaapi+Wayland = rendering corruption in totem (but not in gst-play-1.0)

[Daniel van Vugt]

After successfully getting gst-vaapi to work in a Wayland session (either requires Weston, or you to unset $DISPLAY in Gnome Shell), totem produces rendering corruption. Strangely enough though, gst-play-1.0 has no such corruption.

Note: The technique of unsetting $DISPLAY to avoid Xwayland and use Wayland-proper only seems to work for totem, not gst-play-1.0. gst-play-1.0 only renders to Wayland successfully (without corruption) in Weston.

Tested with:
http://distribution.bbb3d.renderfarming.net/video/mp4/bbb_sunflower_1080p_60fps_normal.mp4

[Daniel van Vugt (vanvugt)]

Confirmed the problem seems to be in the clutter plugin:

env -uDISPLAY gst-launch-1.0 filesrc location=bbb_sunflower_1080p_60fps_normal.mp4 ! qtdemux ! vaapidecodebin ! clutterautovideosink

so a workaround is to avoid clutter:

env -uDISPLAY gst-launch-1.0 filesrc location=bbb_sunflower_1080p_60fps_normal.mp4 ! qtdemux ! vaapidecodebin ! glimagesink

[Daniel van Vugt (vanvugt)]

Note that you may notice very high CPU usage with clutter rendering (especially in totem). Although that's a concurrent problem, it should be treated separately; in bug 1698282.

[Daniel van Vugt (vanvugt)]

I have published an experimental fix for the Wayland-specific corruption and performance issues here:

https://launchpad.net/~vanvugt/+archive/ubuntu/videoaccel
gstreamer-vaapi 1.12.2-1ubuntu1vanvugtppa1

BEFORE
Wayland Gnome..totem..... 60% and corrupt (LP: #1701463)
Wayland Gnome..gst-play.. 5% but requires workarounds (LP: #1698287)
Wayland Gnome..cluttergst 52% and corrupt (LP: #1701463) \
Wayland Gnome..glimagesnk 3% and smooth / gst-launch-1.0
Wayland.Weston.totem..... 62% and corrupt (LP: #1701463)
Wayland.Weston.gst-play.. 4% and smooth
Xorg Gnome.....totem..... 12% and jerky (LP: #1698282, LP: #1698270)
Xorg Gnome.....gst-play.. 4% and smooth

AFTER
Wayland Gnome..totem..... 25% and jerky (LP: #1698282, LP: #1698270)
Wayland Gnome..gst-play.. 8% but requires workarounds (LP: #1698287)
Wayland Gnome..cluttergst 5% and smooth \
Wayland Gnome..glimagesnk 5% and smooth / gst-launch-1.0
Wayland.Weston.totem..... 10% and jerky (LP: #1698282, LP: #1698270)
Wayland.Weston.gst-play.. 4% and smooth
Xorg Gnome.....totem..... 13% and jerky (LP: #1698282, LP: #1698270)
Xorg Gnome.....gst-play.. 4% and smooth

[Daniel van Vugt (vanvugt)]

Patch for artful attached.

[Sebastien Bacher (seb128)]

Thanks Daniel, could you include some header in the patch though (http://dep.debian.net/deps/dep3/)?

[Daniel van Vugt (vanvugt)]

I was aiming to just use the same patch file as I had given to upstream (generated by git), but OK I can reformat it...

[Daniel van Vugt (vanvugt)]

Same patch, but more verbose (DEP-3).

[Launchpad Janitor (janitor)]

This bug was fixed in the package gstreamer-vaapi - 1.12.2-1ubuntu2

---------------
gstreamer-vaapi (1.12.2-1ubuntu2) artful; urgency=medium

  * Add gstreamer-vaapi-EGL-GLTextureUpload-2f368a4d.patch
    - Fixes corruption on Wayland (LP: #1701463)
    - Improves performance (eliminating software buffer copies in clutter-gst)
    - Note: Intel users will also need fix: i965-va-driver 1.8.3-1ubuntu1,
      or else may just see a black image.

 -- Daniel van Vugt <email address hidden> Fri, 04 Aug 2017 15:12:58 +0800