Comment 8 for bug 97555

I removed the restricted modules and nvidia-glx stuff and installed driver from nvidia's site. That fixed the problem.
I attach my new X log as I didn't change anything other than the driver, so you can see any differences.
If you need me to test anything, I can reinstall the ubuntu driver.