Deleting .config/evolution did not work for me, however removing the evolution packages (and so the associated entries in gconf) and reinstalling did stop this happening.
Deleting .config/evolution did not work for me, however removing the evolution packages (and so the associated entries in gconf) and reinstalling did stop this happening.