Re: follow up II - newbie questions, sum over range, rounding of special problematic values

2021-05-23 Thread Steven D'Aprano
On Sun, May 23, 2021 at 12:42:29PM -0600, Andreas J. Guelzow wrote: > Hi, > > On 2021-05-22 7:26 p.m., Steven D'Aprano wrote: > > > >input0.24997 > > You are playing at the edge of the maximum mantissa length. Did you ever > try using that number in LibreOffice or

Aw: Re: follow up II - newbie questions, sum over range, rounding of special problematic values

2021-05-23 Thread b. via gnumeric-list
  hi, >You are playing at the edge of the maximum mantissa length. Did you ever try using that number in LibreOffice or Excel? i know ;-)   i do also know that Excel and LO try to avoid user irritations by some 'rounding' or 'bit truncating', know that it doesn't work well and so on, but that

follow up ...

2021-05-23 Thread User Hayden via gnumeric-list
Back in the days of DOS there was a solution for folks who wanted floating point calculations to act like calculations done with pencil and paper algorithms. It was called Binary Coded Decimal. Instead of representing the entire real with a base 2 float it represented each digit with a binary

Re: follow up II - newbie questions, sum over range, rounding of special problematic values

2021-05-23 Thread Andreas J. Guelzow
Hi, On 2021-05-22 7:26 p.m., Steven D'Aprano wrote: input 0.24997 You are playing at the edge of the maximum mantissa length. Did you ever try using that number in LibreOffice or Excel? Andreas ___ gnumeric-list mailing list