Kernel crash in 3.13.0-51.84 on VMware ESXi 5.5

[David Andruczyk]

Applying 3.13.0-51.84 as per normal update process, reboot of node results in hard crash. Unfortunately since it's on VMware ESXi it's no possible to catch scrollback, however a screenshot of hte majority of the crash is linked below:
.http://i.imgur.com/y1531Bl.png

This happened across 12 VMware ESXI VM's (some apache+php5-fpm webservers, other were MySQL nodes), the only resolution was a hard powe rdown and power up selecting the previous kernel.

Call Trace from the above Image:
? audit_compare_dname_path+0x2b/0xa0
__audit_inode_child+0xb6/0x330
? d_instantiate+0x50/0x70
vfs_mknod+0x110/0x160
unix_bind+0x2a5/0x360
? __audit_sockaddr+0x42,0x80
SYSC_bind+0xe0/0x120
Sys_bind+0xe/0x10
system_call_fastpath+0x1a/0x1f

ProblemType: Bug
DistroRelease: Ubuntu 14.04
Package: linux-image-3.13.0-49-generic 3.13.0-49.83
ProcVersionSignature: Ubuntu 3.13.0-49.83-generic 3.13.11-ckt17
Uname: Linux 3.13.0-49-generic x86_64
AlsaDevices:
 total 0
 crw-rw---- 1 root audio 116, 1 Apr 30 10:55 seq
 crw-rw---- 1 root audio 116, 33 Apr 30 10:55 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.14.1-0ubuntu3.10
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: Error: [Errno 2] No such file or directory: 'iw'
CurrentDmesg:

Date: Thu Apr 30 10:56:47 2015
HibernationDevice: RESUME=/dev/mapper/vg00-swap
IwConfig:
 eth0 no wireless extensions.

 eth1 no wireless extensions.

 lo no wireless extensions.
Lsusb: Error: command ['lsusb'] failed with exit code 1: unable to initialize libusb: -99
MachineType: VMware, Inc. VMware Virtual Platform
PciMultimedia:

ProcEnviron:
 LANGUAGE=en_US:
 TERM=linux
 PATH=(custom, no user)
 LANG=en_US
 SHELL=/bin/bash
ProcFB: 0 svgadrmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.13.0-49-generic root=/dev/mapper/vg00-root ro elevator=noop
RelatedPackageVersions:
 linux-restricted-modules-3.13.0-49-generic N/A
 linux-backports-modules-3.13.0-49-generic N/A
 linux-firmware 1.127.11
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 04/14/2014
dmi.bios.vendor: Phoenix Technologies LTD
dmi.bios.version: 6.00
dmi.board.name: 440BX Desktop Reference Platform
dmi.board.vendor: Intel Corporation
dmi.board.version: None
dmi.chassis.asset.tag: No Asset Tag
dmi.chassis.type: 1
dmi.chassis.vendor: No Enclosure
dmi.chassis.version: N/A
dmi.modalias: dmi:bvnPhoenixTechnologiesLTD:bvr6.00:bd04/14/2014:svnVMware,Inc.:pnVMwareVirtualPlatform:pvrNone:rvnIntelCorporation:rn440BXDesktopReferencePlatform:rvrNone:cvnNoEnclosure:ct1:cvrN/A:
dmi.product.name: VMware Virtual Platform
dmi.product.version: None
dmi.sys.vendor: VMware, Inc.

[Dave Gilbert (ubuntu-treblig)]

Critical: It wont boot any more, and it's a regression on LTS.

[Brad Figg (brad-figg)]

This change was made by a bot.

[David Andruczyk (david-andruczyk)]

Disabling my audit config and rules seems to present the crash.

[David Andruczyk (david-andruczyk)]

NOTE: Most of these systems that were crashing were Apache Webservers using php5-fpm with unix domain socket communication between the two of them, the other's were MySQL, they didn't crash as quickly but did within minutes of bootup. All packages were ubuntu repo provided, though the apache and php configuration are custom for the environment.

[David Andruczyk (david-andruczyk)]

Audit rules trigger this crash. (Strlen)
See http://imgur.com/sWXVpvX,yYMgmOS#0

Linked to bug https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1444141

[Chris J Arges (arges)]

Take a look at this bug, I have a patched package that may fix it:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1450442

Thanks

[David Andruczyk (david-andruczyk)]

3.13.0.52.85 STILL exhibits the exact same problem and crash