Re: Spreadsheets and precision?
This is where reading the doc. helps (marks added) :) QUOTIENT This function is only available if Analysis AddIn is installed. Returns the _integer_ result of a division operation. Syntax QUOTIENT(Numerator;Denominator) Example =QUOTIENT(11;3) returns 3. _The remainder of 2 is omitted._ > > Hi All, > > Does anyone know how to get any kind of decent precision out of either > oocalc or gnumeric? > > I'm trying a simple formula: > =QUOTIENT(3329.10;10) > > Which leads to the answer 332.00 rather 332.90. Which is really just > wrong, especially since what I *really* want to do involves numbers > requiring much higher precision: > > =QUOTIENT(301.52;3329.10) > > Should not yield an answer of 0.00 :) > > I will admit to being a complete and utter idiot when it comes to > spreadsheets, but I tried the obvios of increasing the cell format to > go out to several decimal places. > > Any ideas? > > Thanks. > -- > Seeya, > Paul > ___ > gnhlug-discuss mailing list > gnhlug-discuss@mail.gnhlug.org > http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/ > ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Spreadsheets and precision?
[EMAIL PROTECTED] (Lee A. Newcomb) writes: > This is where reading the doc. helps (marks added) :) > > QUOTIENT > This function is only available if Analysis AddIn is installed. For some reason, I don't see this statement anywhere, but since I have the function available, I must have that AddIn. > Returns the _integer_ result of a division operation. Oh. I do see that now that I look. This strikes me as completely counter-intuitive. So, how to people do actual division in spreadsheets? Does Excel suffer from this as well? /me goes back to emacs, which operates with expected/desired/useful behavior :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Spreadsheets and precision?
Paul Lussier <[EMAIL PROTECTED]> writes: > Hi All, > > Does anyone know how to get any kind of decent precision out of either > oocalc or gnumeric? Dope slap! The obvious answer is: use emacs (M-x ses-mode), where formulas are elisp functions! (/ 3329.10 10) works, and makes a whole lot more sense than =QUOTIENT(3329.10;10) any day, *and* actually results in a correct answer! My mantra of "If emacs can't do it, then I don't need to!" seems to continue to be correct :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Spreadsheets and precision?
> Oh. I do see that now that I look. This strikes me as completely > counter-intuitive. So, how to people do actual division in > spreadsheets? Does Excel suffer from this as well? Yes. Every spreadsheet since VisiCalc has done floating point division and other basic numeric formuli in formulaic form as =3329.10/10 and used NamedFunctions() only for things without conventional (to business folks) infix notation. VisiCalc and Lotus 1-2-3 allowed +3329.10/10 and might figure out that 3329.10/10 was NOT a date and work, but OO.o.C and "Excel" insist on = prefix for any non-constant formula -- Bill [EMAIL PROTECTED] [EMAIL PROTECTED] ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Spreadsheets and precision?
On Sun, 9 Sep 2007 14:01:56 -0400 "Bill Ricker" <[EMAIL PROTECTED]> wrote: > > Oh. I do see that now that I look. This strikes me as completely > > counter-intuitive. So, how to people do actual division in > > spreadsheets? Does Excel suffer from this as well? > > Yes. > > Every spreadsheet since VisiCalc has done floating point division and > other basic numeric formuli in formulaic form as > > =3329.10/10 > > and used NamedFunctions() only for things without conventional (to > business folks) infix notation. > > VisiCalc and Lotus 1-2-3 allowed >+3329.10/10 > and might figure out that > 3329.10/10 > was NOT a date and work, but OO.o.C and "Excel" insist on = prefix for > any non-constant formula Just to elaborate, floating point (doubles) uses 1 sign bit, 11 exponent bits and 53 mantissa bits. Note that the high order mantissa bit is hidden except in denormals which is why 1 + 11 + 53 = 65. The exponent is based on power of 2 which is why you might see a lot of 9 digits. You can use the format cell menu item to expand the visible precision, but you are limited about 17 digits. Some chips use 80 bits in their coprocessor. -- Jerry Feldman <[EMAIL PROTECTED]> Boston Linux and Unix user group http://www.blu.org PGP key id:C5061EA9 PGP Key fingerprint:053C 73EC 3AC1 5C44 3E14 9245 FB00 3ED5 C506 1EA9 signature.asc Description: PGP signature ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Spreadsheets and precision?
On 9/9/07, Paul Lussier <[EMAIL PROTECTED]> wrote: > So, how to people do actual division in > spreadsheets? The same way as you state Emacs does: With the slash (/). I'm just sayin'... ;-) -- Ben ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Spreadsheets and precision?
"Bill Ricker" <[EMAIL PROTECTED]> writes: > Every spreadsheet since VisiCalc has done floating point division and > other basic numeric formuli in formulaic form as > > =3329.10/10 > > and used NamedFunctions() only for things without conventional (to > business folks) infix notation. As I said: >> I will admit to being a complete and utter idiot when it comes to >> spreadsheets :) I also said: >> I tried the obvious of increasing the cell format to go out to >> several decimal places. I guess I just didn't try the *really* obvious of "just plugging in the numbers" to see if the "obvious" would work. I'm not sure if that makes it obvious or not :) But, I do feel like a real dope now! -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
