I confirm this bug as well. In this message: http://lists.xiph.org/pipermail/vorbis/2009-October/027414.html there is a workaround by Gregory Maxwell, which is to invoke ogg123 using "--audio-buffer 0". Hello vorbis developers. Do you know how to fix this?