AES-XTS poor performance in Ubuntu 16.04

[bugproxy]

== Comment: #0 - Paulo Flabiano Smorigo <email address hidden> - 2016-07-21 09:57:49 ==
---Problem Description---

Pre-sales customer observed slow performance of XTS using our system, multiple times slower then Haswell. We work to support it on VMX and managed to increase the performance by 20 times.

---uname output---
N/A

---Additional Hardware Info---
N/A

Machine Type = P8

---Debugger---
A debugger is not configured

---Steps to Reproduce---
 N/A

Contact Information = Paulo Flabiano Smorigo <email address hidden>

Stack trace output:
 no

Oops output:
 no

System Dump Info:
  The system is not configured to capture a system dump.

*Additional Instructions for Paulo Flabiano Smorigo <email address hidden>:
-Post a private note with access information to the machine that the bug is occuring on.
-Attach sysctl -a output output to the bug.

== Comment: #1 - Paulo Flabiano Smorigo <email address hidden> - 2016-07-21 10:02:19 ==
The necessary patches:

http://git.kernel.org/cgit/linux/kernel/git/herbert/cryptodev-2.6.git/commit/?id=11c6e16ee13ab68b8ff04c17ab41611a4fcc5c81
http://git.kernel.org/cgit/linux/kernel/git/herbert/cryptodev-2.6.git/commit/?id=c07f5d3da643329f38ff7c2ef2252723453dd9c4
http://git.kernel.org/cgit/linux/kernel/git/herbert/cryptodev-2.6.git/commit/?id=16dee78005be9908197c707393a3b6a61a14b4fb

[Tim Gardner (timg-tpi)]

Merged in 4.8-rc1

[Tim Gardner (timg-tpi)]

https://lists.ubuntu.com/archives/kernel-team/2016-August/079557.html

[Marcelo Cerri (mhcerri)]

We will need this patch too:

http://<email address hidden>/msg20770.html

Herbert accepted it but it didn't push it to his repo.

[Tim Gardner (timg-tpi)]

This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-xenial' to 'verification-done-xenial'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

[Paulo Flabiano Smorigo (pfsmorigo)]

Working as expected. 20 times faster. :)

root@xenial:~# uname -a
Linux xenial 4.4.0-38-generic #57-Ubuntu SMP Tue Sep 6 15:40:06 UTC 2016 ppc64le ppc64le ppc64le GNU/Linux

root@xenial:~# cryptsetup benchmark -c aes-xts
# Tests are approximate using memory only (no storage IO).
# Algorithm | Key | Encryption | Decryption
     aes-xts 256b 129.1 MiB/s 129.4 MiB/s

root@xenial:~# modprobe vmx_crypto

root@xenial:~# cryptsetup benchmark -c aes-xts
# Tests are approximate using memory only (no storage IO).
# Algorithm | Key | Encryption | Decryption
     aes-xts 256b 2453.1 MiB/s 2521.1 MiB/s

/etc/crypo for vmx modules:
ghash p8_ghash vmx_crypto 1000 1 passed no shash 16 16
xts(aes) p8_aes_xts vmx_crypto 2000 1 passed no blkcipher 16 32 64 16 <default>
ctr(aes) p8_aes_ctr vmx_crypto 2000 1 passed no blkcipher 1 16 32 16 <default>
cbc(aes) p8_aes_cbc vmx_crypto 2000 1 passed no blkcipher 16 16 32 16 <default>
aes p8_aes vmx_crypto 1000 1 passed no cipher 16 16 32

[Launchpad Janitor (janitor)]

This bug was fixed in the package linux - 4.4.0-38.57

---------------
linux (4.4.0-38.57) xenial; urgency=low

  [ Tim Gardner ]

  * Release Tracking Bug
    - LP: #1620658

  * CIFS client: access problems after updating to kernel 4.4.0-29-generic
    (LP: #1612135)
    - Revert "UBUNTU: SAUCE: (namespace) Bypass sget() capability check for nfs"
    - fs: Call d_automount with the filesystems creds

  * apt-key add fails in overlayfs (LP: #1618572)
    - SAUCE: overlayfs: fix regression in whiteout detection

linux (4.4.0-37.56) xenial; urgency=low

  [ Tim Gardner ]

  * Release Tracking Bug
    - LP: #1618040

  * [Feature] Instruction decoder support for new SKX instructions- AVX512
    (LP: #1591655)
    - x86/insn: perf tools: Fix vcvtph2ps instruction decoding
    - x86/insn: Add AVX-512 support to the instruction decoder
    - perf tools: Add AVX-512 support to the instruction decoder used by Intel PT
    - perf tools: Add AVX-512 instructions to the new instructions test

  * [Ubuntu 16.04] FCoE Lun not visible in OS with inbox driver - Issue with
    ioremap() call on 32bit kernel (LP: #1608652)
    - lpfc: Correct issue with ioremap() call on 32bit kernel

  * [Feature] turbostat support for Skylake-SP server (LP: #1591802)
    - tools/power turbostat: decode more CPUID fields
    - tools/power turbostat: CPUID(0x16) leaf shows base, max, and bus frequency
    - tools/power turbostat: decode HWP registers
    - tools/power turbostat: Decode MSR_MISC_PWR_MGMT
    - tools/power turbostat: allow sub-sec intervals
    - tools/power turbostat: Intel Xeon x200: fix erroneous bclk value
    - tools/power turbostat: Intel Xeon x200: fix turbo-ratio decoding
    - tools/power turbostat: re-name "%Busy" field to "Busy%"
    - tools/power turbostat: add --out option for saving output in a file
    - tools/power turbostat: fix compiler warnings
    - tools/power turbostat: make fewer systems calls
    - tools/power turbostat: show IRQs per CPU
    - tools/power turbostat: show GFXMHz
    - tools/power turbostat: show GFX%rc6
    - tools/power turbostat: detect and work around syscall jitter
    - tools/power turbostat: indicate SMX and SGX support
    - tools/power turbostat: call __cpuid() instead of __get_cpuid()
    - tools/power turbostat: correct output for MSR_NHM_SNB_PKG_CST_CFG_CTL dump
    - tools/power turbostat: bugfix: TDP MSRs print bits fixing
    - tools/power turbostat: SGX state should print only if --debug
    - tools/power turbostat: print IRTL MSRs
    - tools/power turbostat: initial BXT support
    - tools/power turbostat: decode BXT TSC frequency via CPUID
    - tools/power turbostat: initial SKX support

  * [BYT] display hotplug doesn't work on console (LP: #1616894)
    - drm/i915/vlv: Make intel_crt_reset() per-encoder
    - drm/i915/vlv: Reset the ADPA in vlv_display_power_well_init()
    - drm/i915/vlv: Disable HPD in valleyview_crt_detect_hotplug()
    - drm/i915: Enable polling when we don't have hpd

  * [Feature]intel_idle enabling on Broxton-P (LP: #1520446)
    - intel_idle: add BXT support

  * [Feature] EDAC: Update driver for SKX-SP (LP: #1591815)
    - [Config] CONFIG_EDAC_SKX=m
    - EDAC, skx_edac: Ad...

[Paulo Flabiano Smorigo (pfsmorigo)]

Canonical,

Can you include commit 901d3d4fee83e9407d91e7178048e2fed6c91f6b in order to fix a problem found by Li Zhong?

I tested and it's working fine.

Thanks!

[Tim Gardner (timg-tpi)]

https://lists.ubuntu.com/archives/kernel-team/2016-September/080111.html

[Seth Forshee (sforshee)]

This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-xenial' to 'verification-done-xenial'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

[Paulo Flabiano Smorigo (pfsmorigo)]

Tested using 4.4.0-39-generic. Working fine, thanks.

[Launchpad Janitor (janitor)]

This bug was fixed in the package linux - 4.4.0-47.68

---------------
linux (4.4.0-47.68) xenial; urgency=low

  [ Kamal Mostafa ]

  * Release Tracking Bug
    - LP: #1636941

  * Add a driver for Amazon Elastic Network Adapters (ENA) (LP: #1635721)
    - lib/bitmap.c: conversion routines to/from u32 array
    - net: ethtool: add new ETHTOOL_xLINKSETTINGS API
    - net: ena: Add a driver for Amazon Elastic Network Adapters (ENA)
    - [config] enable CONFIG_ENA_ETHERNET=m (Amazon ENA driver)

  * unexpectedly large memory usage of mounted snaps (LP: #1636847)
    - [Config] switch squashfs to single threaded decode

 -- Kamal Mostafa <email address hidden> Wed, 26 Oct 2016 10:47:55 -0700