With this ppa https://launchpad.net/~themuso/+archive/ppa pulseaudio loads the modul and receiving streams works. 
But after a while the sounds starts to stutter. I dont know if it is a problem of sending the stream into the network, of receiving the stream, a hardware problem or even a problem with the switches.

pulseaudio -vvv on the receiving machine:

D: memblockq.c: memblockq requested: maxlength=33554432, tlength=0, base=4, prebuf=0, minreq=1 maxrewind=0
D: memblockq.c: memblockq sanitized: maxlength=33554432, tlength=33554432, base=4, prebuf=0, minreq=4 maxrewind=0
I: sink-input.c: Created input 0 "RTP Stream (PulseAudio RTP Stream on janbuntu)" on alsa_output.pci_1002_4383_sound_card_0 with sample spec s16be 2ch 44100Hz and channel map front-left,front-right
D: memblockq.c: memblockq requested: maxlength=41943040, tlength=41943040, base=4, prebuf=74120, minreq=0 maxrewind=0
D: memblockq.c: memblockq sanitized: maxlength=41943040, tlength=41943040, base=4, prebuf=74120, minreq=4 maxrewind=0
D: alsa-sink.c: Requested volume: 0: 100% 1: 100%
D: alsa-sink.c: Got hardware volume: 0: 100% 1: 100%
D: alsa-sink.c: Calculated software volume: 0: 100% 1: 100%
D: core-subscribe.c: Dropped redundant event due to change event.
I: module-rtp-recv.c: New session 'PulseAudio RTP Stream on janbuntu'
D: module-rtp-recv.c: Requesting rewind due to end of underrun
D: alsa-sink.c: Requested to rewind 14080 bytes.
D: alsa-sink.c: Limited to 10524 bytes.
D: alsa-sink.c: before: 2631
D: alsa-sink.c: after: 2631
D: alsa-sink.c: Rewound 10524 bytes.
D: sink.c: Processing rewind...
D: sink-input.c: Have to rewind 10524 bytes on render memblockq.
D: source.c: Processing rewind...
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=5006331 ri=4658503
D: module-rtp-recv.c: Write index deviates by 429,52 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 43479 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=10160478 ri=9729754
D: module-rtp-recv.c: Write index deviates by 513,70 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 43599 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=15182668 ri=14701254
D: module-rtp-recv.c: Write index deviates by 563,19 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44156 Hz.
D: module-rtp-recv.c: Checking for dead streams ...
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=19959078 ri=19523507
D: module-rtp-recv.c: Write index deviates by 521,75 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44347 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=24864790 ri=24439984
D: module-rtp-recv.c: Write index deviates by 504,98 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44390 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=29829967 ri=29426447
D: module-rtp-recv.c: Write index deviates by 485,98 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44267 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=34918914 ri=34510583
D: module-rtp-recv.c: Write index deviates by 490,84 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44187 Hz.
D: module-rtp-recv.c: Checking for dead streams ...
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=39980083 ri=39577251
D: module-rtp-recv.c: Write index deviates by 482,86 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44036 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=45146790 ri=44727041
D: module-rtp-recv.c: Write index deviates by 504,65 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44077 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=50079121 ri=49687592
D: module-rtp-recv.c: Write index deviates by 477,05 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 43875 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=55381719 ri=54912364
D: module-rtp-recv.c: Write index deviates by 550,92 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44324 Hz.
D: module-rtp-recv.c: Checking for dead streams ...
D: module-hal-detect.c: dbus: interface=org.freedesktop.ConsoleKit.Seat, path=/org/freedesktop/ConsoleKit/Seat1, member=SessionAdded
D: module-console-kit.c: dbus: interface=org.freedesktop.ConsoleKit.Seat, path=/org/freedesktop/ConsoleKit/Seat1, member=SessionAdded
D: module-hal-detect.c: dbus: interface=org.freedesktop.ConsoleKit.Seat, path=/org/freedesktop/ConsoleKit/Seat1, member=SessionRemoved
D: module-console-kit.c: dbus: interface=org.freedesktop.ConsoleKit.Seat, path=/org/freedesktop/ConsoleKit/Seat1, member=SessionRemoved
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=59728150 ri=59359263
D: module-rtp-recv.c: Write index deviates by 450,31 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 43886 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=65487116 ri=64961035
D: module-rtp-recv.c: Write index deviates by 610,12 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 44857 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=69044025 ri=68562766
D: module-rtp-recv.c: Write index deviates by 565,90 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 45438 Hz.
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=72870832 ri=72686297
D: module-rtp-recv.c: Write index deviates by 266,74 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 43381 Hz.
D: module-rtp-recv.c: Checking for dead streams ...
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=82050234 ri=81134137
D: module-rtp-recv.c: Write index deviates by 999,98 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 47790 Hz.
D: module-rtp-recv.c: Requesting rewind due to end of underrun
D: alsa-sink.c: Requested to rewind 14076 bytes.
D: alsa-sink.c: Limited to 10520 bytes.
D: alsa-sink.c: before: 2630
D: alsa-sink.c: after: 2630
D: alsa-sink.c: Rewound 10520 bytes.
D: sink.c: Processing rewind...
D: sink-input.c: Have to rewind 10520 bytes on render memblockq.
D: source.c: Processing rewind...
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=82220891 ri=78302573
D: module-rtp-recv.c: Write index deviates by 4003,32 ms, expected 500,00 ms
D: module-rtp-recv.c: Hmmm, rate fix is too large (30899 Hz), not applying.
D: module-rtp-recv.c: Updated sampling rate to 47790 Hz.
D: module-rtp-recv.c: Requesting rewind due to end of underrun
D: alsa-sink.c: Requested to rewind 14076 bytes.
D: alsa-sink.c: Limited to 10524 bytes.
D: alsa-sink.c: before: 2631
D: alsa-sink.c: after: 2631
D: alsa-sink.c: Rewound 10524 bytes.
D: sink.c: Processing rewind...
D: sink-input.c: Have to rewind 10524 bytes on render memblockq.
D: source.c: Processing rewind...
D: module-rtp-recv.c: Updating sample rate
D: module-rtp-recv.c: wi=83499536 ri=82949571
D: module-rtp-recv.c: Write index deviates by 630,01 ms, expected 500,00 ms
D: module-rtp-recv.c: Updated sampling rate to 48936 Hz.
D: module-rtp-recv.c: Requesting rewind due to end of underrun
D: alsa-sink.c: Requested to rewind 14076 bytes.
D: alsa-sink.c: Limited to 10524 bytes.
D: alsa-sink.c: before: 2631
D: alsa-sink.c: after: 2631
D: alsa-sink.c: Rewound 10524 bytes.
D: sink.c: Processing rewind...
D: sink-input.c: Have to rewind 10524 bytes on render memblockq.
D: source.c: Processing rewind...
^CI: main.c: Signal SIGINT empfangen.
I: main.c: Wird beendet.
I: main.c: Herunterfahren des Daemon gestartet.