Note that purge/remove will only remove the package and packages that are directly dependent on it, e.g. evolution-plugins. Packages that have been installed as a requirement for the soon to be removed package (evolution) are marked auto and will get removed with 'autoremove' if no dependent package on it is found.
I do think apt does the right thing. On Precise I did:
$ sudo apt-get install evolution
$ sudo apt-get purge evolution
$ sudo apt-get autoremove
Note that purge/remove will only remove the package and packages that are directly dependent on it, e.g. evolution-plugins. Packages that have been installed as a requirement for the soon to be removed package (evolution) are marked auto and will get removed with 'autoremove' if no dependent package on it is found.
I mark the bug invalid.