On Fri, Oct 09, 2009 at 10:50:49AM -0700, George Hartzell scratched on the wall:
> It seems odd. Are the values large enought that they're causing > problems with the 32-bit floats? Yes. 32-bit IEEE 754 floats offer 23+1 bits of precision, which translates to about 7.2 base-10 digits. Those numbers are 8 digits long, so you're going to start to see rounding and clipping oddness. -j -- Jay A. Kreibich < J A Y @ K R E I B I.C H > "Our opponent is an alien starship packed with atomic bombs. We have a protractor." "I'll go home and see if I can scrounge up a ruler and a piece of string." --from Anathem by Neal Stephenson _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
