I removed the nvidia drivers coming with the distro, and installed the latest 64bit drivers from the Nvidia website (270.41.06) just in case. Problem still persists.
I then removed those drivers, and installed the nouveau driver via apt. Problem still persists.
Sumary: This problem does not seem to be directly related to the GPU drivers.