There are two sides to this:
1/ VLC 2.0.4 starts PulseAudio playback late. This should be fixed in VLC-2.0 commits 0554a01551ae49613062c2d96701d277000e4109 and 9701837bb454c682ba5697e665d79d6e51ae305d.
2/ Depending on the audio hardware, PulseAudio tends to suspend the VLC sink (input) and then spends almost 2 seconds between the time VLC asks to start and the time it actually starts. I believe this is a PulseAudio bug and I have been bringing it on #pulseaudio for several months. But the PulseAudio developers are not paid to support VLC, so they are in no hurry to fix it.
There are two sides to this: 13062c2d96701d2 77000e4109 and 9701837bb454c68 2ba5697e665d79d 6e51ae305d.
1/ VLC 2.0.4 starts PulseAudio playback late. This should be fixed in VLC-2.0 commits 0554a01551ae496
2/ Depending on the audio hardware, PulseAudio tends to suspend the VLC sink (input) and then spends almost 2 seconds between the time VLC asks to start and the time it actually starts. I believe this is a PulseAudio bug and I have been bringing it on #pulseaudio for several months. But the PulseAudio developers are not paid to support VLC, so they are in no hurry to fix it.