Closing this report then. If anyone experiences problems with user switching in Xubuntu 14.04, please look at bug 1320560.
Closing this report then. If anyone experiences problems with user switching in Xubuntu 14.04, please look at bug 1320560.