GL_OUT_OF_MEMORY error when switching to VT. Crash in nux::GLFramebufferObject::IsValid

[Thomi Richards]

I'm running unity & nux trunk, compiz & everything else from precise repos.

When I switch to a VT with Ctrl+Alt+F1 *and* when I try and restart unity by running "unity &", compiz/unity crashes.

I've attached a photo of the error I get that includes the GL_OUT_OF_MEMORY error, the gdb log (that includes the stack trace), and the unity log (which doesn't look very useful to me).

ProblemType: Bug
DistroRelease: Ubuntu 12.04
Package: unity 5.12-0ubuntu1.1
ProcVersionSignature: Ubuntu 3.2.0-26.41-generic 3.2.19
Uname: Linux 3.2.0-26-generic x86_64
NonfreeKernelModules: nvidia
.proc.driver.nvidia.gpus.0: Error: [Errno 21] Is a directory: '/proc/driver/nvidia/gpus/0'
.proc.driver.nvidia.registry: Binary: ""
.proc.driver.nvidia.version:
 NVRM version: NVIDIA UNIX x86_64 Kernel Module 295.40 Thu Apr 5 21:37:00 PDT 2012
 GCC version: gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)
.tmp.unity.support.test.0:

ApportVersion: 2.0.1-0ubuntu8
Architecture: amd64
CompizPlugins: [core,composite,opengl,compiztoolbox,decor,place,session,mousepoll,vpswitch,snap,grid,resize,gnomecompat,regex,imgpng,move,animation,workarounds,wall,unitymtgrabhandles,expo,fade,ezoom,scale,unityshell]
CompositorRunning: compiz
Date: Wed Jul 11 13:45:22 2012
DistUpgraded: 2012-01-18 11:08:01,845 DEBUG enabling apt cron job
DistroCodename: precise
DistroVariant: ubuntu
GraphicsCard:
 NVIDIA Corporation Device [10de:1251] (rev a1) (prog-if 00 [VGA controller])
   Subsystem: CLEVO/KAPOK Computer Device [1558:5102]
InstallationMedia: Ubuntu 11.10 "Oneiric Ocelot" - Release amd64 (20111012)
JockeyStatus:
 xorg:nvidia_current - NVIDIA accelerated graphics driver (Proprietary, Enabled, In use)
 xorg:nvidia_current_updates - NVIDIA accelerated graphics driver (post-release updates) (Proprietary, Disabled, Not in use)
MachineType: System76, Inc. Serval Professional
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.2.0-26-generic root=UUID=1ad6d244-76e1-48be-b7b7-983c06853cdb ro quiet splash vt.handoff=7
SourcePackage: unity
UpgradeStatus: Upgraded to precise on 2012-01-17 (175 days ago)
dmi.bios.date: 08/09/2011
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 4.6.4
dmi.board.asset.tag: Not Applicable
dmi.board.name: Serval Professional
dmi.board.vendor: System76, Inc.
dmi.board.version: serp7
dmi.chassis.asset.tag: Not Applicable
dmi.chassis.type: 10
dmi.chassis.vendor: System76, Inc.
dmi.chassis.version: serp7
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr4.6.4:bd08/09/2011:svnSystem76,Inc.:pnServalProfessional:pvrserp7:rvnSystem76,Inc.:rnServalProfessional:rvrserp7:cvnSystem76,Inc.:ct10:cvrserp7:
dmi.product.name: Serval Professional
dmi.product.version: serp7
dmi.sys.vendor: System76, Inc.
version.compiz: compiz 1:0.9.7.8-0ubuntu1
version.ia32-libs: ia32-libs N/A
version.libdrm2: libdrm2 2.4.32-1ubuntu1
version.libgl1-mesa-dri: libgl1-mesa-dri 8.0.2-0ubuntu3.1
version.libgl1-mesa-dri-experimental: libgl1-mesa-dri-experimental N/A
version.libgl1-mesa-glx: libgl1-mesa-glx 8.0.2-0ubuntu3.1
version.nvidia-graphics-drivers: nvidia-graphics-drivers N/A
version.xserver-xorg-core: xserver-xorg-core 2:1.11.4-0ubuntu10.3
version.xserver-xorg-input-evdev: xserver-xorg-input-evdev 1:2.7.0-0ubuntu1.2
version.xserver-xorg-video-ati: xserver-xorg-video-ati 1:6.14.99~git20111219.aacbd629-0ubuntu2
version.xserver-xorg-video-intel: xserver-xorg-video-intel 2:2.17.0-1ubuntu4
version.xserver-xorg-video-nouveau: xserver-xorg-video-nouveau 1:0.0.16+git20111201+b5534a1-1build2

[Daniel van Vugt (vanvugt)]

The offending code is GLDeviceFrameBufferObject.cpp:275:

      case GL_FRAMEBUFFER_UNSUPPORTED_EXT:
        nuxError("[GLFramebufferObject::IsValid] GL_FRAMEBUFFER_UNSUPPORTED_EXT");
        isOK = false;
        break;

Looks like nuxError triggers a debug break/abort which is a crash to the user. But this is an error we should recover from.

[Jay Taoko (jaytaoko)]

nuxError, stops the program if Nux has been compiled in debug mode with --enable-debug. Otherwise, nuxError does not halt the program.
I prevented nuxError from stoping the program on error in debug mode. This does not resolve the issue.
Also, going to VT F1, I get a black screen on my NVidia system. Going back to VT F7, Unity/Compiz crashes. This problem does not occure on system with an Intel GPU.

[Thomi Richards (thomir-deactivatedaccount)]

With Jay's branch, I no longer get the stack trace originally posted in this bug. Instead, I get this:

http://paste.ubuntu.com/1088762/

90% of the time when I try and start unity from a VT.