Exaile 0.3.0 from exaile-devel ppa I think. Or from distro repos, I'm not shure; how do I check it out? I'm running Ubuntu 9.04.
1. Rate a song through a tray menu. It displays 4 stars, for example.
2. Wait for the next track starts playing (or manually press next in the main window or via hotkey, whatever).
3. Open up tray menu again.
4. See the 4 stars again in any case, had the new song 2 stars, 3 or no rating at all. Till you hover the rating menu item.
Another way to reproduce:
1. Open exaile main window.
2. Start any track.
3. Change its rating not via tray menu.
4. Open up tray menu and see the rating not being changed again till you hover it.