Harold Fuchs wrote:
On 14/07/09 17:45, Per wrote:
1234567898765 1234567898765
12345678987654 12345678987654
123456789876543 123456789876543
*1234567898765432 1234567898765430 *
I´ve just tried Excel (version 2002, aka MS Office XP, on a WIN XP
machine, SP3....)
I got just the same result, see the blue-marked numbers.....
I even tried this in a spreadsheet of MS Works, version 7, and I got
the same round up there...
Is it a sort of handling the numbers in Works, Calc and Excel that
causes the round-up effect???
// Per
As I said, it's a consequence of handling numbers on a 32-bit computer
using a data type usually known as "float" in which real numbers (in
the mathematical sense) are stored as 32 bits. If the application used
a data type usually referred to as "double" then those numbers would
be stored as 64 bits and would be able to store larger integer values
precisely. There is software around for handling arbitrarily large
integers with 100% precision but it's not used outside some very
specialised applications.
I have to say I'm very surprised that Calc, Excel etc. don't use
"double".
If someone needs more precision in Calc, there is the following:
http://www.richhillsoftware.com/blog/archives/2005/06/xnumbers_011_no.html
which can handle up to 200 digits.
Joe Conner, Poulsbo, WA USA
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscr...@openoffice.org
For additional commands, e-mail: users-h...@openoffice.org
