[Vorbis-dev] Checking accuracy of the output

[Tal]

Hi,
Thanks for the quick response,
We did some optimizations that deliberately cut some corners.  
Is there a more accurate test to see if the the output is not hurt?

Tal.

P.S.
I mailed it directly to you by mistake :(
Thanks for catching it.


-----Original Message-----
From: Michael Smith [mailto:mlrsmith at gmail.com] 
Sent: Sunday, January 23, 2005 10:46 AM
To: Tal
Subject: Re: [Vorbis-dev] Checking accuracy of the output


On Sun, 23 Jan 2005 10:11:42 +0200, Tal <shabi at t2.technion.ac.il> wrote:
> Hi,
> We've changed the encoder.
> We've made all sorts of optimizations.
> How can we check that issues that you've brought up? "(how close your 
> encoder is to the reference one, how close the result is to the 
> original input, how good the result sounds, etc.)"

Well, if what you've done is 'just' optimisation, then the encoder
output should be identical. In that case, you only need to check that
the produced bitstreams are identical (note that most encoders (such as
oggenc) use a random serial number - you'll need to set that to the same
number for both encodes, oggenc has an option for doing that).

If you've made changes that produce (deliberately) different output,
then it's much, much more complex. You really need to do double-blind
listening tests to see whether your improvements are, in fact,
improvements.

Mike

p.s. Did you mean to keep this on the mailing list? You mailed me
directly...