If you using the plain xchat and not xchat-gnome, you should be able to fix this by tweaking the alerts preferences.
If you using the plain xchat and not xchat-gnome, you should be able to fix this by tweaking the alerts preferences.