[Speex-dev] More floating point errors

Alex Bakaev Alex.Bakaev at citrix.com
Mon Dec 12 22:31:20 PST 2005


Hi!

It seems that using a different compiler (I assume the
development is done with MSC) uncovers various issues
with the floating point.

Here is the second one I'm seeing - DOMAIN error from
sqrt().

In the open_loop_nbest_pitch(), this line:

          g = DIV32(corr[i-start],
10+SHR32(MULT16_16(spx_sqrt(e0),spx_sqrt(energy[i-start])
),6));

The values are:

e0 is 7.2
i is 142,
start is 17
energy [i-start] is -2.1004911E-015


Hope this information is enough to go on.

Tia,
.a
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.xiph.org/pipermail/speex-dev/attachments/20051212/931e9f96/attachment.html


More information about the Speex-dev mailing list