I talked to the Pulseaudio developers on IRC. Disabling the module "module-suspend-on-idle" solves this problem.
I talked to the Pulseaudio developers on IRC. Disabling the module "module- suspend- on-idle" solves this problem.