[Speex-dev] More floating point errors
Alex Bakaev
Alex.Bakaev at citrix.com
Mon Dec 12 22:31:20 PST 2005
Hi!
It seems that using a different compiler (I assume the
development is done with MSC) uncovers various issues
with the floating point.
Here is the second one I'm seeing - DOMAIN error from
sqrt().
In the open_loop_nbest_pitch(), this line:
g = DIV32(corr[i-start],
10+SHR32(MULT16_16(spx_sqrt(e0),spx_sqrt(energy[i-start])
),6));
The values are:
e0 is 7.2
i is 142,
start is 17
energy [i-start] is -2.1004911E-015
Hope this information is enough to go on.
Tia,
.a
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.xiph.org/pipermail/speex-dev/attachments/20051212/931e9f96/attachment.html
More information about the Speex-dev
mailing list