[opus] Antw: [EXT] Opus merging streams

Sampo Syreeni decoy at iki.fi
Tue Apr 5 23:51:00 UTC 2022

On 2022-03-24, Andrew Sonzogni wrote:

> Then it’s not possible to mix those packets before decoding them ?

*Theoretically* you can mix without decoding to *some* degree. But the 
algorithm to do so would be...truly nasty. So just don't go there. You 
need to decode, mix, and recode.

BTW, in many cases, you'd want to hold the separate incoming streams as 
separate already, and just pass them on. E.g. in conferencing 
applications, you'd typically not want to mix everything together, 
because 1) the mixer would prove a single point of failure, 2) business 
oriented conferencing is often an application where what people say is 
legally encumbered or might prove so later on, including the mixer, and 
3) you typically don't want more than one person to take the stage 
anyhow, because absent body language and other close interaction, it'd 
just be an auditory mess.
Sampo Syreeni, aka decoy - decoy at iki.fi, http://decoy.iki.fi/front
+358-40-3751464, 025E D175 ABE5 027C 9494 EEB0 E090 8BA9 0509 85C2

More information about the opus mailing list